Re: [PR] [Test](nereids) add UT for dropCached/Expired/StatsCommand in nereids [doris]
yx-keith commented on PR #49308: URL: https://github.com/apache/doris/pull/49308#issuecomment-2741984607 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49051-branch-3.0 created (now b4a0d427500)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49051-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at b4a0d427500 [improvement](statistics)Remove read lock when doing db analyze. (#49250) (#49321) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
doris.git: Error while running github feature from main:.asf.yaml
An error occurred while processing the github feature in .asf.yaml: while parsing a mapping in "doris.git/.asf.yaml::github", line 72, column 1: - BE UT (Doris BE UT) ^ (line: 72) unexpected key not in schema 'required_pull_request_reviews' in "doris.git/.asf.yaml::github", line 75, column 1: required_pull_request_reviews: ^ (line: 75) --- With regards, ASF Infra. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
doris.git: Error while running github feature from master:.asf.yaml
An error occurred while processing the github feature in .asf.yaml: while parsing a mapping in "doris.git/.asf.yaml::github", line 111, column 1: - Build Broker ^ (line: 111) unexpected key not in schema 'required_pull_request_reviews' in "doris.git/.asf.yaml::github", line 114, column 1: - COMPILE (DORIS_COMPILE) ^ (line: 114) --- With regards, ASF Infra. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](cloud-mow)Add some metrics aboout delete bitmap update lock [doris]
doris-robot commented on PR #47988: URL: https://github.com/apache/doris/pull/47988#issuecomment-2742166221 TPC-H: Total hot run time: 34234 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit af8c71680fb78aa883e7907ae16ded497032c0ff, data reload: false -- Round 1 -- q1 24324 497749844977 q2 2047303 169 169 q3 10401 1220679 679 q4 10239 1026558 558 q5 7526235827032358 q6 182 165 130 130 q7 907 733 604 604 q8 9333131810701070 q9 6908520252315202 q10 6879230018941894 q11 497 270 266 266 q12 342 355 219 219 q13 17771 368230503050 q14 224 232 224 224 q15 521 488 479 479 q16 632 614 591 591 q17 582 843 330 330 q18 7611729872917291 q19 1587949 554 554 q20 332 317 200 200 q21 3991270324402440 q22 10111025949 949 Total cold run time: 113847 ms Total hot run time: 34234 ms - Round 2, with runtime_filter_mode=off - q1 5108506850865068 q2 241 322 237 237 q3 2177270322832283 q4 1453184514101410 q5 4402442344174417 q6 220 175 125 125 q7 2059195217891789 q8 2609266226122612 q9 7280726770507050 q10 2943320027402740 q11 576 502 501 501 q12 665 761 631 631 q13 3459389432703270 q14 319 311 280 280 q15 518 479 462 462 q16 648 707 644 644 q17 1161159913461346 q18 7800775473817381 q19 796 801 822 801 q20 1866196217881788 q21 5384482947974797 q22 1087106310051005 Total cold run time: 52771 ms Total hot run time: 50637 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49051-branch-2.1 deleted (was 54b3000de51)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49051-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git was 54b3000de51 [fix](auth)create view check select_priv of table instead of column (#49268) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
doris.git: Error while running github feature from auto-pick-49051-branch-2.1:.asf.yaml
An error occurred while processing the github feature in .asf.yaml: while parsing a mapping in "doris.git/.asf.yaml::github", line 78, column 1: - Build Third Party Librar ... ^ (line: 78) unexpected key not in schema 'required_pull_request_reviews' in "doris.git/.asf.yaml::github", line 81, column 1: ^ (line: 81) --- With regards, ASF Infra. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
doris.git: Error while running github feature from main:.asf.yaml
An error occurred while processing the github feature in .asf.yaml: while parsing a mapping in "doris.git/.asf.yaml::github", line 78, column 1: - Build Third Party Librar ... ^ (line: 78) unexpected key not in schema 'required_pull_request_reviews' in "doris.git/.asf.yaml::github", line 81, column 1: ^ (line: 81) --- With regards, ASF Infra. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](cloud-schema-change) Remove schema change job even if alter version < 2 [doris]
github-actions[bot] commented on PR #49062: URL: https://github.com/apache/doris/pull/49062#issuecomment-2742179117 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](cloud-mow)Add some metrics aboout delete bitmap update lock [doris]
doris-robot commented on PR #47988: URL: https://github.com/apache/doris/pull/47988#issuecomment-2742187842 ClickBench: Total hot run time: 31.85 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit af8c71680fb78aa883e7907ae16ded497032c0ff, data reload: false query1 0.040.030.03 query2 0.120.100.11 query3 0.250.190.20 query4 1.590.200.19 query5 0.580.580.59 query6 1.180.710.72 query7 0.020.020.02 query8 0.040.040.03 query9 0.590.520.52 query10 0.590.580.56 query11 0.150.100.10 query12 0.140.110.11 query13 0.610.590.60 query14 2.662.832.70 query15 0.910.840.86 query16 0.380.380.40 query17 1.031.051.04 query18 0.210.200.20 query19 1.931.991.80 query20 0.010.020.01 query21 15.34 0.880.55 query22 0.741.230.74 query23 14.78 1.400.63 query24 6.691.731.50 query25 0.470.090.22 query26 0.660.170.13 query27 0.050.050.05 query28 9.920.800.43 query29 12.52 3.943.30 query30 0.240.090.06 query31 2.830.580.38 query32 3.220.540.46 query33 3.003.073.05 query34 15.82 5.134.47 query35 4.524.524.51 query36 0.670.500.48 query37 0.090.060.06 query38 0.040.030.03 query39 0.030.020.02 query40 0.170.130.13 query41 0.080.030.03 query42 0.040.020.02 query43 0.040.030.03 Total cold run time: 104.99 s Total hot run time: 31.85 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Test](nereids) Add ut for alter column/table stats command in nereids [doris]
doris-robot commented on PR #49278: URL: https://github.com/apache/doris/pull/49278#issuecomment-2742208298 TPC-H: Total hot run time: 34033 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 7f48765f7806e6f4fa6e109f46034eafbfc0, data reload: false -- Round 1 -- q1 24213 502450055005 q2 2041304 190 190 q3 10393 1211674 674 q4 10224 985 509 509 q5 7527235922902290 q6 186 162 128 128 q7 923 725 601 601 q8 9305129211361136 q9 6893520352185203 q10 6833231419051905 q11 467 268 269 268 q12 347 357 212 212 q13 17775 365230583058 q14 234 230 207 207 q15 521 481 487 481 q16 614 600 583 583 q17 592 844 341 341 q18 7554708371427083 q19 1231955 557 557 q20 309 314 190 190 q21 3983338024822482 q22 10331010930 930 Total cold run time: 113198 ms Total hot run time: 34033 ms - Round 2, with runtime_filter_mode=off - q1 5105511751175117 q2 230 322 222 222 q3 2109266823122312 q4 1385178713721372 q5 4414434144454341 q6 217 168 134 134 q7 1994193917741774 q8 2587266326012601 q9 7319714870907090 q10 2975322827352735 q11 569 517 480 480 q12 666 741 624 624 q13 3563386633803380 q14 297 305 276 276 q15 548 515 499 499 q16 660 671 686 671 q17 1138160413271327 q18 7757771875757575 q19 808 791 980 791 q20 1937195918181818 q21 5251490347494749 q22 1086104110151015 Total cold run time: 52615 ms Total hot run time: 50903 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Test](nereids) Add ut for alter column/table stats command in nereids [doris]
doris-robot commented on PR #49278: URL: https://github.com/apache/doris/pull/49278#issuecomment-2742225366 TPC-DS: Total hot run time: 193326 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 7f48765f7806e6f4fa6e109f46034eafbfc0, data reload: false query1 1405105310301030 query2 6026187318741873 query3 10998 451744854485 query4 55881 25695 22964 22964 query5 5205553 486 486 query6 384 200 186 186 query7 5090506 273 273 query8 325 250 262 250 query9 6337256525812565 query10 421 324 272 272 query11 15543 15042 14999 14999 query12 159 112 105 105 query13 1166513 425 425 query14 11760 714378847143 query15 191 204 185 185 query16 7038664 510 510 query17 1076728 573 573 query18 1550430 316 316 query19 198 189 160 160 query20 132 134 123 123 query21 203 120 107 107 query22 4463442343464346 query23 33928 33304 33298 33298 query24 6150243523902390 query25 460 467 415 415 query26 758 273 163 163 query27 1945489 326 326 query28 2739243424462434 query29 590 578 449 449 query30 272 227 194 194 query31 915 871 755 755 query32 79 66 60 60 query33 462 365 304 304 query34 772 850 520 520 query35 879 856 766 766 query36 954 1023882 882 query37 120 103 79 79 query38 4218419143644191 query39 1491141814051405 query40 222 117 103 103 query41 54 52 50 50 query42 122 105 101 101 query43 495 490 480 480 query44 1330815 802 802 query45 185 182 167 167 query46 842 1042647 647 query47 1859189817611761 query48 400 427 318 318 query49 742 515 427 427 query50 713 759 422 422 query51 4238433442154215 query52 112 108 98 98 query53 224 268 179 179 query54 489 489 409 409 query55 117 81 83 81 query56 258 281 262 262 query57 1179119511151115 query58 250 247 236 236 query59 2764278825372537 query60 286 289 268 268 query61 155 126 134 126 query62 722 738 654 654 query63 226 185 178 178 query64 23621049693 693 query65 4542443644584436 query66 772 394 285 285 query67 15901 15382 15160 15160 query68 7592804 492 492 query69 528 309 258 258 query70 1217109811021098 query71 455 306 265 265 query72 6170504050675040 query73 1128608 345 345 query74 9072917289298929 query75 3617322527442744 query76 40781183745 745 query77 606 358 272 272 query78 10194 10061 93009300 query79 2971805 555 555 query80 821 508 439 439 query81 484 256 227 227 query82 678 122 92 92 query83 301 170 154 154 query84 293 94 73 73 query85 783 356 309 309 query86 394 293 275 275 query87 4566446644454445 query88 3561225022762250 query89 402 310 278 278 query90 1766207 201 201 query91 139 210 111 111 query92 75 60 58 58 query93 21431049566 566 query94 688 420 298 298 query95 343 269 264 264 query96 501 568 277 277 query97 3307341232913291 query98 231 208 204 204 query99 1445138412541254 Total cold run time: 304393 ms Total hot run time: 193326 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [I] [Discuss] Doris Roadmap 2025 [doris]
httpshirley commented on issue #47948: URL: https://github.com/apache/doris/issues/47948#issuecomment-2742177621 Hi community, the Apache Doris 2025 Roadmap Overview Webinar is available on YouTube: https://www.youtube.com/watch?v=MsIIzmQIE6M -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (6c5fe76bd09 -> 20e5d5d075c)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 6c5fe76bd09 Automated deployment with doris branch @ 48d2ec015be758292f2741f46c13d771f1006be7 new 20e5d5d075c Automated deployment with doris branch @ 48d2ec015be758292f2741f46c13d771f1006be7 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (6c5fe76bd09) \ N -- N -- N refs/heads/asf-site (20e5d5d075c) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](statistics)Remove read lock when doing db analyze. (#49250) [doris]
dataroaring merged PR #49321: URL: https://github.com/apache/doris/pull/49321 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Nereids) support turn off ONLY_FULL_GROUP_BY sql mode [doris]
hello-stephen commented on PR #49341: URL: https://github.com/apache/doris/pull/49341#issuecomment-2742278749 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](statistics)Fix replace table doesn't remove table stat meta memory leak bug. [doris]
Jibing-Li opened a new pull request, #49345: URL: https://github.com/apache/doris/pull/49345 ### What problem does this PR solve? Fix replace table doesn't remove table stat meta bug. When doing replace table with property swap=false, the old table is removed. In this case, we need to remove the table stats meta object for that table to avoid memory leak. Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [x] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [x] No. - [ ] Yes. - Does this need documentation? - [x] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) fold constant for string function process emoji character by mistake (#49087) [doris]
LiBinfeng-01 commented on PR #49344: URL: https://github.com/apache/doris/pull/49344#issuecomment-2742493787 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](test) Force enable light schema change for check before quit #49301 [doris]
hello-stephen commented on PR #49339: URL: https://github.com/apache/doris/pull/49339#issuecomment-2742046861 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-3.0: [fix](test) Force enable light schema change for check before quit #49301 [doris]
github-actions[bot] opened a new pull request, #49339: URL: https://github.com/apache/doris/pull/49339 Cherry-picked from #49301 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Test](nereids) add UT for dropCached/Expired/StatsCommand in nereids [doris]
doris-robot commented on PR #49308: URL: https://github.com/apache/doris/pull/49308#issuecomment-2742046240 TPC-DS: Total hot run time: 195192 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 9a7f00b1d722e89d22c695c5e3ed3a2d1db36f1f, data reload: false query1 1450106110621061 query2 6155193618941894 query3 11048 448444724472 query4 54295 25909 23147 23147 query5 5088633 469 469 query6 326 203 190 190 query7 4889493 283 283 query8 321 270 238 238 query9 5667259926022599 query10 457 303 258 258 query11 15320 15187 15184 15184 query12 167 114 105 105 query13 1047529 401 401 query14 10879 725479027254 query15 204 201 177 177 query16 6996673 482 482 query17 1117721 600 600 query18 1474384 318 318 query19 211 188 182 182 query20 138 119 128 119 query21 211 123 109 109 query22 4274438642214221 query23 34278 33452 33539 33452 query24 5674255124582458 query25 476 476 387 387 query26 676 279 153 153 query27 1870512 326 326 query28 2824245924542454 query29 585 643 457 457 query30 272 220 192 192 query31 892 854 800 800 query32 72 65 66 65 query33 465 353 329 329 query34 772 874 512 512 query35 827 858 780 780 query36 979 1005913 913 query37 125 99 80 80 query38 4188445441724172 query39 1500147614321432 query40 207 120 107 107 query41 50 51 55 51 query42 119 114 104 104 query43 497 517 468 468 query44 1375850 829 829 query45 185 175 175 175 query46 897 1054664 664 query47 1816188217961796 query48 390 436 330 330 query49 719 552 444 444 query50 738 796 440 440 query51 4286431542584258 query52 113 119 105 105 query53 235 269 187 187 query54 534 521 445 445 query55 89 92 84 84 query56 301 291 290 290 query57 1249123511471147 query58 256 249 263 249 query59 2610275928092759 query60 285 309 263 263 query61 133 132 126 126 query62 784 734 656 656 query63 224 197 189 189 query64 14731064703 703 query65 4593448744384438 query66 743 392 300 300 query67 15769 15596 15448 15448 query68 7140831 512 512 query69 538 311 271 271 query70 1216114410981098 query71 522 305 269 269 query72 5512526253715262 query73 1440686 346 346 query74 9016917688448844 query75 4245326727712771 query76 42831190765 765 query77 737 384 283 283 query78 10084 10253 92599259 query79 2670839 572 572 query80 706 524 471 471 query81 493 261 223 223 query82 667 130 94 94 query83 239 169 152 152 query84 279 105 71 71 query85 815 363 313 313 query86 368 312 293 293 query87 4589459944624462 query88 3450225222432243 query89 413 321 275 275 query90 1942214 215 214 query91 146 150 113 113 query92 75 58 55 55 query93 16661078586 586 query94 667 411 305 305 query95 359 277 263 263 query96 494 566 277 277 query97 3383341532733273 query98 235 202 204 202 query99 1456139312751275 Total cold run time: 298724 ms Total hot run time: 195192 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] enhance like add escape syntax [doris]
UoweMe commented on PR #47993: URL: https://github.com/apache/doris/pull/47993#issuecomment-2742104929 Hello，When do you think this problem will be fixed? I think we need to fix the version of Doris that has problems here. If the fix is relatively quick, I think it would be more convenient to upgrade Doris. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](nereids) proper planning of shadow columns for load and schema change concurrent execution #49332 [doris]
doris-robot commented on PR #49338: URL: https://github.com/apache/doris/pull/49338#issuecomment-2742107926 ClickBench: Total hot run time: 31.71 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 42c6da0ea984c3f5a929c7466d47f3ca80031715, data reload: false query1 0.030.030.03 query2 0.060.030.03 query3 0.240.070.07 query4 1.630.100.10 query5 0.510.530.51 query6 1.130.720.73 query7 0.020.020.02 query8 0.040.030.03 query9 0.550.490.49 query10 0.550.550.54 query11 0.140.100.10 query12 0.140.120.11 query13 0.610.590.58 query14 2.722.752.83 query15 0.900.830.82 query16 0.390.380.38 query17 1.060.991.02 query18 0.230.220.22 query19 1.941.852.03 query20 0.020.020.01 query21 15.37 0.590.59 query22 2.712.541.63 query23 17.08 0.940.75 query24 3.361.190.87 query25 0.380.230.05 query26 0.330.140.13 query27 0.050.040.04 query28 10.13 0.530.46 query29 12.59 3.253.26 query30 0.250.050.05 query31 2.870.410.38 query32 3.240.460.47 query33 2.963.013.04 query34 17.33 4.434.45 query35 4.584.534.48 query36 0.680.470.47 query37 0.090.070.06 query38 0.040.030.04 query39 0.040.020.02 query40 0.160.130.13 query41 0.080.030.02 query42 0.040.020.02 query43 0.030.030.03 Total cold run time: 107.3 s Total hot run time: 31.71 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](restore) Link existing rowset files bidirectionally [doris]
doris-robot commented on PR #49233: URL: https://github.com/apache/doris/pull/49233#issuecomment-2741074172 TPC-DS: Total hot run time: 194663 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 3a2db8210388452b2e7dabc75482d779f457bff5, data reload: false query1 1415109710531053 query2 6161196019651960 query3 11159 460046444600 query4 26166 23383 23122 23122 query5 3573656 481 481 query6 320 216 199 199 query7 3992476 269 269 query8 320 248 236 236 query9 8489262026152615 query10 451 302 264 264 query11 15436 15221 14851 14851 query12 183 121 109 109 query13 1571520 403 403 query14 10662 667470666674 query15 197 184 168 168 query16 7631677 483 483 query17 1287717 571 571 query18 2045412 304 304 query19 193 188 159 159 query20 126 127 111 111 query21 207 124 110 110 query22 4598458944714471 query23 34329 33469 33734 33469 query24 7587248124762476 query25 545 460 410 410 query26 1163274 142 142 query27 2189507 358 358 query28 4124243624252425 query29 695 558 435 435 query30 278 220 192 192 query31 919 921 781 781 query32 72 68 69 68 query33 551 393 303 303 query34 826 875 521 521 query35 836 860 799 799 query36 984 1003937 937 query37 126 101 77 77 query38 4191426843284268 query39 1520142914411429 query40 215 122 106 106 query41 53 54 53 53 query42 124 103 109 103 query43 521 516 485 485 query44 1368819 835 819 query45 184 173 170 170 query46 890 1027654 654 query47 1806184117711771 query48 386 412 314 314 query49 773 534 421 421 query50 728 757 426 426 query51 4353433143674331 query52 110 106 102 102 query53 242 257 184 184 query54 504 507 416 416 query55 83 89 84 84 query56 283 279 278 278 query57 1196118711151115 query58 253 271 247 247 query59 2824287528032803 query60 301 304 277 277 query61 132 126 124 124 query62 805 744 699 699 query63 238 186 184 184 query64 42941043701 701 query65 4537452145104510 query66 956 439 332 332 query67 16288 15377 15417 15377 query68 8401839 509 509 query69 478 298 272 272 query70 1210116010801080 query71 477 311 281 281 query72 5316494048634863 query73 664 559 340 340 query74 9261913988138813 query75 3920325827482748 query76 37331193754 754 query77 816 365 279 279 query78 10097 10144 94049404 query79 3097808 543 543 query80 681 500 534 500 query81 480 269 232 232 query82 704 123 98 98 query83 175 171 148 148 query84 232 91 75 75 query85 796 346 308 308 query86 377 299 286 286 query87 4505459346064593 query88 3739228522682268 query89 416 316 280 280 query90 1866215 214 214 query91 134 152 109 109 query92 77 60 56 56 query93 22941127584 584 query94 634 416 302 302 query95 387 274 267 267 query96 488 570 281 281 query97 3328340833273327 query98 234 207 204 204 query99 1357140712561256 Total cold run time: 281938 ms Total hot run time: 194663 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
(doris-website) branch asf-site updated (15431e7ae1d -> 61405b5ed77)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 15431e7ae1d Automated deployment with doris branch @ 48d2ec015be758292f2741f46c13d771f1006be7 new 61405b5ed77 Automated deployment with doris branch @ 48d2ec015be758292f2741f46c13d771f1006be7 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (15431e7ae1d) \ N -- N -- N refs/heads/asf-site (61405b5ed77) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](Compaction) Add cumulative compaction delay strategy [doris]
hello-stephen commented on PR #48759: URL: https://github.com/apache/doris/pull/48759#issuecomment-2741632684 # BE UT Coverage Report Increment line coverage `49.30% (70/142)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/ec2f3375fdd054d66a0222e1905b7fc1b55740ab_ec2f3375fdd054d66a0222e1905b7fc1b55740ab/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/ec2f3375fdd054d66a0222e1905b7fc1b55740ab_ec2f3375fdd054d66a0222e1905b7fc1b55740ab/report/index.html) | Category | Coverage | |---|| | Function Coverage | 49.96% (13369/26761) | | Line Coverage | 39.41% (115680/293562) | | Region Coverage | 38.11% (58720/154071) | | Branch Coverage | 33.23% (29624/89146) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](cloud) improve the retry policy of cloud mode [doris]
doris-robot commented on PR #49067: URL: https://github.com/apache/doris/pull/49067#issuecomment-2741673899 # BE UT Coverage Report Increment line coverage `0.00% (0/8)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/d4424783e502cdbb242f2f7d3f97ccf4a6c65422_d4424783e502cdbb242f2f7d3f97ccf4a6c65422/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/d4424783e502cdbb242f2f7d3f97ccf4a6c65422_d4424783e502cdbb242f2f7d3f97ccf4a6c65422/report/index.html) | Category | Coverage | |---|| | Function Coverage | 49.96% (13367/26754) | | Line Coverage | 39.40% (115596/293382) | | Region Coverage | 38.11% (58679/153992) | | Branch Coverage | 33.22% (29600/89096) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (61405b5ed77 -> d851b5280a0)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 61405b5ed77 Automated deployment with doris branch @ 48d2ec015be758292f2741f46c13d771f1006be7 new d851b5280a0 Automated deployment with doris branch @ 48d2ec015be758292f2741f46c13d771f1006be7 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (61405b5ed77) \ N -- N -- N refs/heads/asf-site (d851b5280a0) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](restore) Link existing rowset files bidirectionally [doris]
doris-robot commented on PR #49233: URL: https://github.com/apache/doris/pull/49233#issuecomment-2741043029 TPC-H: Total hot run time: 34439 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 3a2db8210388452b2e7dabc75482d779f457bff5, data reload: false -- Round 1 -- q1 24096 501750185017 q2 2046300 172 172 q3 10400 1219688 688 q4 10219 993 550 550 q5 7513237023552355 q6 188 160 135 135 q7 909 742 591 591 q8 9311128711751175 q9 6828517651575157 q10 6823230818971897 q11 500 279 261 261 q12 359 361 219 219 q13 17772 375231423142 q14 250 242 221 221 q15 528 486 494 486 q16 617 630 602 602 q17 572 856 345 345 q18 7714728070707070 q19 1231951 557 557 q20 329 319 194 194 q21 4073355726022602 q22 1087103110031003 Total cold run time: 113365 ms Total hot run time: 34439 ms - Round 2, with runtime_filter_mode=off - q1 5210516051235123 q2 240 327 237 237 q3 2118265922302230 q4 1445181713821382 q5 4466444643894389 q6 222 173 132 132 q7 2003197017951795 q8 2600267126112611 q9 7342723870897089 q10 3047316027832783 q11 595 525 500 500 q12 696 764 626 626 q13 3542390733363336 q14 279 308 310 308 q15 553 521 492 492 q16 648 685 657 657 q17 1148162313461346 q18 7828763075447544 q19 826 831 974 831 q20 2027194218321832 q21 5456499149254925 q22 1115106610451045 Total cold run time: 53406 ms Total hot run time: 51213 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (7ddef8d42ef -> 180040e5300)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 7ddef8d42ef Automated deployment with doris branch @ 48d2ec015be758292f2741f46c13d771f1006be7 new 180040e5300 Automated deployment with doris branch @ 48d2ec015be758292f2741f46c13d771f1006be7 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (7ddef8d42ef) \ N -- N -- N refs/heads/asf-site (180040e5300) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] do exchange refactor [doris]
HappenLee commented on PR #49335: URL: https://github.com/apache/doris/pull/49335#issuecomment-2741254869 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](thrift) remove some unused query options [doris]
doris-robot commented on PR #49254: URL: https://github.com/apache/doris/pull/49254#issuecomment-2741255072 # BE UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/fd3324dc27a3bfe12a68039cd2207dfaeaaa3428_fd3324dc27a3bfe12a68039cd2207dfaeaaa3428/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/fd3324dc27a3bfe12a68039cd2207dfaeaaa3428_fd3324dc27a3bfe12a68039cd2207dfaeaaa3428/report/index.html) | Category | Coverage | |---|| | Function Coverage | 49.96% (13364/26748) | | Line Coverage | 39.41% (115606/293359) | | Region Coverage | 38.10% (58669/153978) | | Branch Coverage | 33.22% (29599/89088) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] do exchange refactor [doris]
hello-stephen commented on PR #49335: URL: https://github.com/apache/doris/pull/49335#issuecomment-2741254676 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](cloud) fix misuse of file_cache_evict_in_advance_batch_bytes [doris]
hello-stephen commented on PR #49336: URL: https://github.com/apache/doris/pull/49336#issuecomment-2741324842 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] do exchange refactor [doris]
doris-robot commented on PR #49335: URL: https://github.com/apache/doris/pull/49335#issuecomment-2741388523 ClickBench: Total hot run time: 31.02 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit c5ed9831e0b6f0b4d2a701e82e64c0689e82239c, data reload: false query1 0.030.040.03 query2 0.120.100.10 query3 0.250.190.19 query4 1.600.190.19 query5 0.600.570.59 query6 1.190.730.72 query7 0.020.010.02 query8 0.040.030.04 query9 0.580.520.53 query10 0.580.590.57 query11 0.150.100.10 query12 0.140.110.12 query13 0.620.600.59 query14 2.672.792.69 query15 0.930.860.84 query16 0.390.370.38 query17 1.031.001.05 query18 0.210.200.19 query19 1.911.921.84 query20 0.020.010.02 query21 15.35 0.880.54 query22 0.771.060.62 query23 15.11 1.380.61 query24 6.882.100.73 query25 0.510.240.17 query26 0.620.160.13 query27 0.060.050.04 query28 9.430.860.44 query29 12.59 3.983.33 query30 0.250.090.06 query31 2.820.580.40 query32 3.230.550.46 query33 3.003.053.07 query34 15.95 5.104.45 query35 4.594.524.56 query36 0.660.500.48 query37 0.080.060.06 query38 0.040.040.04 query39 0.030.020.03 query40 0.160.140.13 query41 0.090.030.02 query42 0.040.020.02 query43 0.040.030.03 Total cold run time: 105.38 s Total hot run time: 31.02 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) initcap constant folding should upper first character in all words (#49061) [doris]
hello-stephen commented on PR #49342: URL: https://github.com/apache/doris/pull/49342#issuecomment-2742431453 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) initcap constant folding should upper first character in all words (#49061) [doris]
LiBinfeng-01 commented on PR #49342: URL: https://github.com/apache/doris/pull/49342#issuecomment-2742431678 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Remove the FE nodes port check to ensure the Spark Doris Connector works correctly when using Nginx as the FE gateway [doris-spark-connector]
JNSimba commented on code in PR #285:
URL:
https://github.com/apache/doris-spark-connector/pull/285#discussion_r2006900633
##
spark-doris-connector/spark-doris-connector-base/src/main/java/org/apache/doris/spark/config/DorisConfig.java:
##
@@ -86,8 +86,10 @@ private void checkOptions(Map options)
throws OptionRequiredExce
String feNodes = options.get(DorisOptions.DORIS_FENODES.getName());
if (feNodes.isEmpty()) {
throw new IllegalArgumentException("option [" +
DorisOptions.DORIS_FENODES.getName() + "] is empty");
-} else if (!feNodes.contains(":")) {
-throw new IllegalArgumentException("option [" +
DorisOptions.DORIS_FENODES.getName() + "] is not in correct format, for
example: host:port[,host2:port]");
+} else if (feNodes.contains(":")) {
+if (!feNodes.matches("([\\w-.]+:\\d+,)*([\\w-.]+:\\d+)")) {
Review Comment:
Can you add a ut for this regex?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](Nereids) initcap constant folding should upper first character in all words (#49061) [doris]
LiBinfeng-01 opened a new pull request, #49342: URL: https://github.com/apache/doris/pull/49342 pick: #49061 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #40441 Problem Summary: ### Release note initcap should upper first character in all words ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](connector)修复spark doris catalog模式下，where条件有case when时报错问题（#282） [doris-spark-connector]
aoyuEra commented on PR #284:
URL:
https://github.com/apache/doris-spark-connector/pull/284#issuecomment-2742446937
这个测试用例，我看了，我这里也尝试写了了一下发现对于CASW_WHEN和后面调整的函数一类的问题测试起来比较麻烦，无法创建NamedReference，这个是有包范围使用限制，所以，我这里基本上都是打包后，在spark应用中调用测试。
回复的原邮件
| 发件人 | ***@***.***> |
| 发送日期 | 2025年3月21日 14:09 |
| 收件人 | ***@***.***> |
| 主题 | 回复： [apache/doris-spark-connector] [fix](connector)修复spark doris
catalog模式下，where条件有case when时报错问题（#282） (PR #284) |
我打包后，在spark应用工程中测试了，没有添加test单元测试例子
回复的原邮件
| 发件人 | ***@***.***> |
| 发送日期 | 2025年3月21日 14:06 |
| 收件人 | ***@***.***> |
| 抄送人 | ***@***.***>,
***@***.***> |
| 主题 | Re: [apache/doris-spark-connector] [fix](connector)修复spark doris
catalog模式下，where条件有case when时报错问题（#282） (PR #284) |
@JNSimba commented on this pull request.
In
spark-doris-connector/spark-doris-connector-spark-3.5/src/main/scala/org/apache/doris/spark/read/expression/V2ExpressionBuilder.scala:
> +case "CASE_WHEN" =>
+ val fragment = new StringBuilder("CASE ")
+ val expressions = e.children()
+
+ for(i<- 0 until expressions.size - 1 by 2){
+fragment.append(s" WHEN ${build(expressions(i))} THEN
${build(expressions(i+1))} ")
+ }
+
+ if (expressions.length % 2 != 0) {
+val last = expressions(expressions.length - 1)
+fragment.append(s" ELSE ${build(last)} ")
+ }
+ fragment.append(" END")
+
+ fragment.mkString
Can you add a test for this?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID:
***@***.***>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Nereids) support turn off ONLY_FULL_GROUP_BY sql mode [doris]
doris-robot commented on PR #49341: URL: https://github.com/apache/doris/pull/49341#issuecomment-2742449537 TPC-H: Total hot run time: 34204 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 48aa6da16252379e091a930bda5ae9753865bb0f, data reload: false -- Round 1 -- q1 24308 503450245024 q2 2045303 169 169 q3 10413 1233697 697 q4 10229 1042568 568 q5 7992250923642364 q6 186 167 133 133 q7 903 752 610 610 q8 9318129812011201 q9 6841515651355135 q10 6835231118831883 q11 485 279 260 260 q12 350 350 216 216 q13 17775 369830963096 q14 229 221 214 214 q15 548 486 487 486 q16 631 607 567 567 q17 571 865 355 355 q18 7713725270227022 q19 2144960 541 541 q20 304 340 201 201 q21 4064270525002500 q22 10791037962 962 Total cold run time: 114963 ms Total hot run time: 34204 ms - Round 2, with runtime_filter_mode=off - q1 5217507550885075 q2 242 319 241 241 q3 2118268323132313 q4 1433182514011401 q5 4518453043914391 q6 231 171 130 130 q7 2006193117711771 q8 2646265025542554 q9 7211736569366936 q10 3044321527552755 q11 583 511 500 500 q12 675 800 626 626 q13 3477391732653265 q14 285 294 284 284 q15 529 482 493 482 q16 661 706 645 645 q17 1193159813921392 q18 7822784474857485 q19 815 828 908 828 q20 2025196117931793 q21 5318492549584925 q22 1102107610251025 Total cold run time: 53151 ms Total hot run time: 50817 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](docker) fix docker entrypoint script adminUser grep rule [doris]
catpineapple opened a new pull request, #49343: URL: https://github.com/apache/doris/pull/49343 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Nereids) support turn off ONLY_FULL_GROUP_BY sql mode [doris]
doris-robot commented on PR #49341: URL: https://github.com/apache/doris/pull/49341#issuecomment-2742470736 TPC-DS: Total hot run time: 193383 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 48aa6da16252379e091a930bda5ae9753865bb0f, data reload: false query1 1398106710391039 query2 6422188718961887 query3 11125 464146784641 query4 26420 23602 23785 23602 query5 5706690 477 477 query6 308 196 193 193 query7 3982483 275 275 query8 297 261 238 238 query9 8534260025992599 query10 539 328 254 254 query11 15361 15149 14836 14836 query12 158 110 108 108 query13 1574513 400 400 query14 9355702361886188 query15 203 181 170 170 query16 7577650 497 497 query17 1116739 562 562 query18 2059439 315 315 query19 190 189 160 160 query20 124 122 120 120 query21 218 127 114 114 query22 4581458044594459 query23 34302 33621 33350 33350 query24 7451242723902390 query25 490 466 402 402 query26 840 262 145 145 query27 2856485 323 323 query28 4388249124642464 query29 639 556 457 457 query30 280 222 194 194 query31 928 880 808 808 query32 76 63 61 61 query33 525 381 311 311 query34 783 913 514 514 query35 784 825 755 755 query36 966 1024930 930 query37 129 105 82 82 query38 4160412140394039 query39 1499144214571442 query40 219 126 108 108 query41 61 60 57 57 query42 132 111 114 111 query43 515 527 469 469 query44 1323839 838 838 query45 190 181 171 171 query46 867 1031635 635 query47 1890189618091809 query48 392 423 303 303 query49 723 505 425 425 query50 701 755 425 425 query51 4327433342574257 query52 112 111 98 98 query53 228 273 177 177 query54 502 516 431 431 query55 80 83 82 82 query56 278 283 273 273 query57 1212119211181118 query58 266 240 243 240 query59 2720285026682668 query60 286 285 271 271 query61 134 124 133 124 query62 780 734 659 659 query63 231 181 181 181 query64 32541034697 697 query65 454044364436 query66 806 424 305 305 query67 15943 15512 15366 15366 query68 9216876 497 497 query69 524 311 264 264 query70 1157104711291047 query71 482 286 261 261 query72 5750513751665137 query73 726 635 349 349 query74 9067881989478819 query75 4519323927312731 query76 37721179751 751 query77 804 354 271 271 query78 10091 10496 93119311 query79 2654804 563 563 query80 581 510 449 449 query81 481 255 223 223 query82 715 123 93 93 query83 174 167 157 157 query84 246 97 76 76 query85 841 348 301 301 query86 338 293 265 265 query87 4441441242464246 query88 3627233522572257 query89 403 307 278 278 query90 1923209 209 209 query91 143 147 108 108 query92 79 59 53 53 query93 17701040578 578 query94 648 385 303 303 query95 340 263 268 263 query96 485 566 276 276 query97 3288336532753275 query98 218 206 200 200 query99 1324139212371237 Total cold run time: 281882 ms Total hot run time: 193383 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
(doris-website) branch asf-site updated (89ed6dbc836 -> 0a0a3e1153b)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 89ed6dbc836 Automated deployment with doris branch @ 48d2ec015be758292f2741f46c13d771f1006be7 new 0a0a3e1153b Automated deployment with doris branch @ 48d2ec015be758292f2741f46c13d771f1006be7 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (89ed6dbc836) \ N -- N -- N refs/heads/asf-site (0a0a3e1153b) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](docker) fix docker entrypoint script adminUser grep rule [doris]
catpineapple commented on PR #49343: URL: https://github.com/apache/doris/pull/49343#issuecomment-2742474259 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](statistics)Remove read lock when doing db analyze. (#49250) [doris]
doris-robot commented on PR #49321: URL: https://github.com/apache/doris/pull/49321#issuecomment-2740147024 TPC-DS: Total hot run time: 197176 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit f6ded7a0cbbb79f2d169e99d773e1086bb7cae35, data reload: false query1 1332938 958 938 query2 6258203220712032 query3 11008 437343784373 query4 65410 28560 23356 23356 query5 4926431 445 431 query6 393 179 177 177 query7 5622312 311 311 query8 294 215 218 215 query9 9277264626532646 query10 494 268 260 260 query11 17456 15113 15689 15113 query12 161 107 104 104 query13 1523465 447 447 query14 10956 730769846984 query15 203 189 183 183 query16 7062469 486 469 query17 1129574 571 571 query18 1839321 307 307 query19 231 159 145 145 query20 110 105 109 105 query21 203 98 99 98 query22 4932474545414541 query23 34510 34118 34356 34118 query24 6121292229262922 query25 564 434 430 430 query26 732 170 172 170 query27 2320355 358 355 query28 4703251824932493 query29 714 458 452 452 query30 235 163 168 163 query31 1034860 854 854 query32 70 59 58 58 query33 455 312 314 312 query34 929 513 530 513 query35 870 756 739 739 query36 1075986 955 955 query37 117 70 69 69 query38 4230397339683968 query39 1538149314691469 query40 218 106 110 106 query41 50 52 49 49 query42 116 102 98 98 query43 552 503 500 500 query44 1189827 839 827 query45 201 172 171 171 query46 1146724 717 717 query47 2090196919371937 query48 468 396 397 396 query49 756 414 421 414 query50 825 441 422 422 query51 7415718971577157 query52 98 87 87 87 query53 256 182 177 177 query54 572 481 454 454 query55 79 77 74 74 query56 281 261 249 249 query57 1255112611201120 query58 211 204 200 200 query59 3078305927512751 query60 281 252 253 252 query61 111 144 113 113 query62 804 654 671 654 query63 218 181 196 181 query64 1385688 637 637 query65 3276319331883188 query66 744 305 291 291 query67 15899 15774 15627 15627 query68 4180584 581 581 query69 426 270 262 262 query70 1167107910571057 query71 364 254 250 250 query72 6373407740374037 query73 757 349 344 344 query74 10133 895791088957 query75 3323265426612654 query76 1954106211551062 query77 480 260 268 260 query78 10560 968196039603 query79 2182600 605 600 query80 1386422 422 422 query81 535 246 246 246 query82 120187 82 82 query83 167 145 140 140 query84 283 80 79 79 query85 971 294 292 292 query86 412 284 300 284 query87 4450426042194219 query88 3959238623712371 query89 423 290 288 288 query90 1965186 198 186 query91 185 155 147 147 query92 59 49 49 49 query93 2817548 546 546 query94 822 289 299 289 query95 358 252 254 252 query96 621 278 278 278 query97 3271315131503150 query98 216 206 209 206 query99 1587128812941288 Total cold run time: 322197 ms Total hot run time: 197176 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] check_overflow_for_number_cast [doris]
doris-robot commented on PR #49270: URL: https://github.com/apache/doris/pull/49270#issuecomment-2740198018 TeamCity cloud ut coverage result: Function Coverage: 83.09% (1081/1301) Line Coverage: 66.10% (18014/27253) Region Coverage: 65.46% (8871/13551) Branch Coverage: 55.35% (4780/8636) Coverage Report: http://coverage.selectdb-in.cc/coverage/9f87b253ff61efca35a16a6abd56d4a4ae69697a_9f87b253ff61efca35a16a6abd56d4a4ae69697a_cloud/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](pipeline) set operator should use local state expr [doris]
Mryange commented on PR #49326: URL: https://github.com/apache/doris/pull/49326#issuecomment-2740212155 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix]fix query statistics leak in BE [doris]
Thearas commented on PR #49325: URL: https://github.com/apache/doris/pull/49325#issuecomment-2740209856 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](pipeline) set operator should use local state expr [doris]
Mryange opened a new pull request, #49326: URL: https://github.com/apache/doris/pull/49326 ### What problem does this PR solve? ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement] add information_schema backend_tablets table [doris]
doris-robot commented on PR #49317: URL: https://github.com/apache/doris/pull/49317#issuecomment-2740369209 TPC-H: Total hot run time: 34242 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 528781e8c6f25443f9a4f309aba31a019c99a864, data reload: false -- Round 1 -- q1 24263 501349754975 q2 2051306 175 175 q3 10392 1261691 691 q4 10240 1054569 569 q5 7686245923482348 q6 184 160 128 128 q7 939 718 616 616 q8 9311135210991099 q9 6842513452065134 q10 6810233118991899 q11 479 282 253 253 q12 349 354 217 217 q13 17765 366130323032 q14 222 223 206 206 q15 549 494 491 491 q16 638 601 571 571 q17 577 869 356 356 q18 7756741172007200 q19 1755957 549 549 q20 320 322 199 199 q21 4160339925362536 q22 10361018998 998 Total cold run time: 114324 ms Total hot run time: 34242 ms - Round 2, with runtime_filter_mode=off - q1 5163504950585049 q2 248 339 229 229 q3 2178271622912291 q4 1456185914201420 q5 4554441644174416 q6 224 179 126 126 q7 2005194417661766 q8 2727267925812581 q9 7342728370717071 q10 3037318527322732 q11 601 514 485 485 q12 722 780 615 615 q13 3515386933033303 q14 291 318 297 297 q15 526 481 477 477 q16 646 683 662 662 q17 1154161313641364 q18 7848767975387538 q19 811 860 1101860 q20 1993197918141814 q21 5341493247804780 q22 106410041004 Total cold run time: 53493 ms Total hot run time: 50880 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement] add information_schema backend_tablets table [doris]
doris-robot commented on PR #49317: URL: https://github.com/apache/doris/pull/49317#issuecomment-2740402299 TPC-DS: Total hot run time: 195457 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 528781e8c6f25443f9a4f309aba31a019c99a864, data reload: false query1 1435106410311031 query2 6272191418981898 query3 11016 465445914591 query4 53511 25742 23564 23564 query5 4994610 488 488 query6 341 201 183 183 query7 4874500 270 270 query8 325 252 243 243 query9 5548256425792564 query10 408 302 263 263 query11 15272 14990 14810 14810 query12 151 111 101 101 query13 1017503 405 405 query14 10793 733678197336 query15 201 212 189 189 query16 7113664 449 449 query17 1108741 571 571 query18 1638420 339 339 query19 199 197 171 171 query20 137 126 121 121 query21 211 135 108 108 query22 4460470045404540 query23 33832 33445 33412 33412 query24 6107243324572433 query25 492 483 436 436 query26 732 269 141 141 query27 1808501 321 321 query28 2791245624412441 query29 573 566 445 445 query30 279 230 186 186 query31 876 867 804 804 query32 72 65 60 60 query33 441 382 345 345 query34 759 835 493 493 query35 805 826 749 749 query36 948 997 887 887 query37 129 103 76 76 query38 4221413041634130 query39 1507146214251425 query40 203 117 102 102 query41 54 51 49 49 query42 117 103 103 103 query43 495 507 479 479 query44 1315811 810 810 query45 175 177 167 167 query46 852 1044649 649 query47 1849193517811781 query48 390 414 306 306 query49 684 508 429 429 query50 691 758 420 420 query51 4355432342714271 query52 105 107 98 98 query53 237 254 182 182 query54 492 494 417 417 query55 86 87 83 83 query56 286 270 272 270 query57 1179120311281128 query58 241 249 241 241 query59 2646279927342734 query60 295 276 289 276 query61 132 127 126 126 query62 718 744 679 679 query63 216 191 183 183 query64 15141062728 728 query65 4597448645124486 query66 725 397 293 293 query67 16041 15663 15488 15488 query68 7196870 498 498 query69 522 301 273 273 query70 1167113311181118 query71 493 287 264 264 query72 5871516052835160 query73 1471657 342 342 query74 9310926589178917 query75 3949324528802880 query76 43171234739 739 query77 678 361 277 277 query78 10103 10132 93269326 query79 2719807 563 563 query80 675 518 446 446 query81 489 270 221 221 query82 671 127 91 91 query83 248 179 151 151 query84 282 97 74 74 query85 787 370 321 321 query86 348 305 272 272 query87 4513443045114430 query88 3347221822302218 query89 404 310 275 275 query90 1981204 207 204 query91 141 144 112 112 query92 75 60 59 59 query93 13881058579 579 query94 680 408 294 294 query95 355 276 262 262 query96 477 575 269 269 query97 3371347433193319 query98 229 207 208 207 query99 1439139212991299 Total cold run time: 297782 ms Total hot run time: 195457 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [fix](pipeline) Make pipeline task shared by task queue [doris]
yiguolei commented on code in PR #49273:
URL: https://github.com/apache/doris/pull/49273#discussion_r2005887280
##
be/src/pipeline/dependency.h:
##
@@ -156,7 +156,7 @@ class Dependency : public
std::enable_shared_from_this {
MonotonicStopWatch _watcher;
std::mutex _task_lock;
-std::vector _blocked_task;
+std::vector> _blocked_task;
Review Comment:
这里是share ptr 感觉会循环引用。
比如你看task ---》 pipeline context ---》state --》dependency ---》 task
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](nereids)no need to analyze prefilter and where condition in routine load [doris]
doris-robot commented on PR #49313: URL: https://github.com/apache/doris/pull/49313#issuecomment-2740842620 TPC-DS: Total hot run time: 186411 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 9afccc3845568fd4242ab357d2eef42caa72d29d, data reload: false query1 1020506 477 477 query2 6547189718801880 query3 6804219 217 217 query4 26260 23678 23110 23110 query5 4313682 495 495 query6 312 202 196 196 query7 4606473 271 271 query8 293 245 244 244 query9 8665258025982580 query10 485 303 247 247 query11 15477 15180 14878 14878 query12 167 112 104 104 query13 1656517 404 404 query14 9631628266216282 query15 202 190 162 162 query16 7712628 478 478 query17 1287723 573 573 query18 2029417 312 312 query19 197 182 205 182 query20 120 113 117 113 query21 204 116 101 101 query22 4239429239413941 query23 33833 32946 32909 32909 query24 7966235923922359 query25 520 440 397 397 query26 1205261 143 143 query27 2523481 320 320 query28 4270242223782378 query29 710 559 420 420 query30 281 220 192 192 query31 969 843 780 780 query32 106 60 59 59 query33 545 357 301 301 query34 779 851 491 491 query35 793 810 753 753 query36 954 986 906 906 query37 119 98 77 77 query38 4314410740934093 query39 1442141714081408 query40 214 117 99 99 query41 56 51 53 51 query42 120 107 100 100 query43 480 487 464 464 query44 1285793 782 782 query45 173 174 164 164 query46 808 1035618 618 query47 1744186817201720 query48 362 401 298 298 query49 790 540 416 416 query50 668 735 401 401 query51 4179419541214121 query52 111 107 96 96 query53 211 241 172 172 query54 481 489 406 406 query55 78 77 83 77 query56 260 271 281 271 query57 1115114310911091 query58 249 262 245 245 query59 2604277926602660 query60 286 270 257 257 query61 127 125 124 124 query62 806 722 682 682 query63 226 178 181 178 query64 42791015659 659 query65 4441433743394337 query66 1074399 346 346 query67 15649 15294 15239 15239 query68 8104894 506 506 query69 465 303 267 267 query70 1128112511121112 query71 461 285 262 262 query72 507050905070 query73 721 624 346 346 query74 9105893489318931 query75 3859323827182718 query76 37271176727 727 query77 790 361 274 274 query78 10013 10044 92809280 query79 2401815 572 572 query80 652 514 426 426 query81 501 320 226 226 query82 221 125 103 103 query83 174 175 159 159 query84 240 93 70 70 query85 805 356 301 301 query86 385 317 278 278 query87 4653435043644350 query88 3871221522272215 query89 383 314 275 275 query90 1886207 210 207 query91 138 144 189 144 query92 80 61 56 56 query93 20691045581 581 query94 622 425 307 307 query95 353 274 262 262 query96 492 560 275 275 query97 3276337033383338 query98 223 212 203 203 query99 1356143212631263 Total cold run time: 275140 ms Total hot run time: 186411 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] [fix](nereids)no need to analyze prefilter and where condition in routine load [doris]
doris-robot commented on PR #49313: URL: https://github.com/apache/doris/pull/49313#issuecomment-2740858705 ClickBench: Total hot run time: 31.09 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 9afccc3845568fd4242ab357d2eef42caa72d29d, data reload: false query1 0.050.040.02 query2 0.120.110.11 query3 0.250.190.18 query4 1.600.180.18 query5 0.580.570.60 query6 1.190.720.72 query7 0.030.010.01 query8 0.040.030.03 query9 0.570.530.52 query10 0.590.580.57 query11 0.160.110.11 query12 0.150.110.12 query13 0.620.590.60 query14 2.832.722.67 query15 0.920.840.85 query16 0.390.380.37 query17 1.011.031.00 query18 0.210.200.19 query19 1.921.881.86 query20 0.010.010.01 query21 15.40 0.860.55 query22 0.771.210.64 query23 14.94 1.340.59 query24 6.612.280.82 query25 0.510.130.26 query26 0.630.160.13 query27 0.040.040.05 query28 9.340.860.44 query29 12.53 3.973.27 query30 0.250.080.06 query31 2.830.590.39 query32 3.230.540.46 query33 2.983.053.08 query34 15.87 5.124.52 query35 4.644.604.54 query36 0.650.500.49 query37 0.080.060.07 query38 0.050.040.04 query39 0.030.020.02 query40 0.170.140.13 query41 0.080.020.02 query42 0.030.020.02 query43 0.030.020.02 Total cold run time: 104.93 s Total hot run time: 31.09 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [case](restore) Rename repo name of backup-restore regression cases with suite name [doris]
doris-robot commented on PR #49237: URL: https://github.com/apache/doris/pull/49237#issuecomment-2740863649 TPC-DS: Total hot run time: 192753 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 2d28f008e7656e8fe70eb74e0873e34cece49955, data reload: false query1 1416103810401038 query2 6258186718691867 query3 11157 442745684427 query4 55042 24690 23075 23075 query5 5174529 459 459 query6 371 204 192 192 query7 5116496 275 275 query8 314 239 229 229 query9 6082258625952586 query10 431 307 245 245 query11 15182 15042 14884 14884 query12 166 113 105 105 query13 1085525 424 424 query14 11577 645479266454 query15 207 199 192 192 query16 6953674 515 515 query17 1089740 607 607 query18 1525411 324 324 query19 201 200 162 162 query20 121 115 126 115 query21 221 124 105 105 query22 4541442742254225 query23 33933 33251 32995 32995 query24 5778242124252421 query25 452 442 413 413 query26 803 282 143 143 query27 1874499 328 328 query28 2816246024502450 query29 586 549 431 431 query30 276 221 195 195 query31 870 898 813 813 query32 72 60 62 60 query33 463 373 315 315 query34 762 869 500 500 query35 816 833 777 777 query36 957 1003891 891 query37 118 98 84 84 query38 4169420141254125 query39 1506144114631441 query40 210 124 103 103 query41 53 48 48 48 query42 119 108 113 108 query43 485 497 459 459 query44 1320816 795 795 query45 179 177 164 164 query46 856 1039644 644 query47 1820192617861786 query48 384 409 310 310 query49 716 522 436 436 query50 704 759 417 417 query51 4341430941734173 query52 109 110 102 102 query53 228 255 184 184 query54 479 484 451 451 query55 90 83 92 83 query56 288 280 276 276 query57 1165120311631163 query58 250 245 247 245 query59 2722283726882688 query60 291 287 262 262 query61 149 132 123 123 query62 745 714 680 680 query63 221 184 194 184 query64 16441052685 685 query65 4523449144294429 query66 735 394 336 336 query67 16070 15429 15425 15425 query68 7929815 522 522 query69 514 300 264 264 query70 118110831083 query71 497 286 268 268 query72 5773511051785110 query73 1041629 334 334 query74 9155914689738973 query75 3843323327102710 query76 43611188766 766 query77 556 377 276 276 query78 10071 10241 92719271 query79 2743798 560 560 query80 663 508 437 437 query81 497 264 218 218 query82 670 131 93 93 query83 304 175 153 153 query84 287 96 75 75 query85 767 413 314 314 query86 378 302 303 302 query87 4631450443414341 query88 3415224622642246 query89 417 312 275 275 query90 1854213 213 213 query91 140 139 107 107 query92 73 57 57 57 query93 20131027577 577 query94 661 399 296 296 query95 351 273 302 273 query96 501 556 275 275 query97 3396335532803280 query98 224 202 198 198 query99 1414138412401240 Total cold run time: 301696 ms Total hot run time: 192753 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [Test](nereids) add UT for dropCached/Expired/StatsCommand in nereids [doris]
doris-robot commented on PR #49308: URL: https://github.com/apache/doris/pull/49308#issuecomment-2740851561 TPC-DS: Total hot run time: 193267 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 6a7ee374eef198ddbed7892173dda377696ba8cb, data reload: false query1 1395106010501050 query2 6200189718671867 query3 11018 457845704570 query4 52572 26105 22949 22949 query5 5107599 487 487 query6 331 195 191 191 query7 4853486 267 267 query8 301 238 222 222 query9 5518257325822573 query10 421 325 264 264 query11 15210 15202 14846 14846 query12 169 115 102 102 query13 1035531 419 419 query14 10474 656373016563 query15 205 214 184 184 query16 7073677 495 495 query17 1100748 585 585 query18 1370421 326 326 query19 203 208 169 169 query20 127 126 125 125 query21 220 127 102 102 query22 4508447743894389 query23 34531 33263 33378 33263 query24 5833245724572457 query25 473 450 393 393 query26 706 247 142 142 query27 1864491 326 326 query28 3107248224392439 query29 559 547 437 437 query30 277 224 189 189 query31 840 893 772 772 query32 71 58 62 58 query33 485 387 316 316 query34 791 859 513 513 query35 802 843 757 757 query36 955 996 917 917 query37 166 102 75 75 query38 4208433243144314 query39 1489141814321418 query40 206 125 108 108 query41 52 52 51 51 query42 127 107 107 107 query43 490 494 481 481 query44 1352850 816 816 query45 187 179 168 168 query46 873 1039657 657 query47 1856184917981798 query48 395 417 306 306 query49 715 521 433 433 query50 690 744 423 423 query51 4321428942694269 query52 106 106 107 106 query53 232 262 174 174 query54 486 519 425 425 query55 85 89 84 84 query56 311 282 271 271 query57 1214120211221122 query58 249 242 238 238 query59 2680293325512551 query60 295 266 267 266 query61 136 126 123 123 query62 739 751 725 725 query63 239 190 184 184 query64 23941056720 720 query65 4538445044464446 query66 788 406 339 339 query67 15946 15658 15279 15279 query68 6957873 515 515 query69 537 306 261 261 query70 1163114011121112 query71 513 295 256 256 query72 5907519652885196 query73 1504690 343 343 query74 8952921087878787 query75 3926325027352735 query76 41711183752 752 query77 669 361 277 277 query78 10009 10176 92569256 query79 2452781 566 566 query80 610 521 429 429 query81 480 253 219 219 query82 576 124 95 95 query83 173 172 218 172 query84 288 92 70 70 query85 763 362 311 311 query86 365 297 284 284 query87 4630450243914391 query88 3810224222102210 query89 404 307 275 275 query90 1807201 204 201 query91 140 140 110 110 query92 71 56 60 56 query93 17871052573 573 query94 663 418 294 294 query95 343 272 260 260 query96 488 564 270 270 query97 3317339433003300 query98 233 203 206 203 query99 1406138612871287 Total cold run time: 297383 ms Total hot run time: 193267 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [Test](nereids) add UT for dropCached/Expired/StatsCommand in nereids [doris]
doris-robot commented on PR #49308: URL: https://github.com/apache/doris/pull/49308#issuecomment-2740867764 ClickBench: Total hot run time: 30.98 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 6a7ee374eef198ddbed7892173dda377696ba8cb, data reload: false query1 0.040.040.03 query2 0.120.110.10 query3 0.250.190.19 query4 1.590.180.20 query5 0.560.550.55 query6 1.180.720.74 query7 0.020.020.02 query8 0.040.030.04 query9 0.580.520.52 query10 0.590.590.56 query11 0.160.110.11 query12 0.140.110.11 query13 0.620.600.61 query14 2.672.672.71 query15 0.910.850.85 query16 0.380.370.38 query17 1.001.001.03 query18 0.210.190.19 query19 2.021.881.83 query20 0.010.020.01 query21 15.35 0.950.55 query22 0.741.320.77 query23 15.09 1.400.66 query24 8.230.740.66 query25 0.500.140.17 query26 0.810.160.13 query27 0.050.040.04 query28 8.440.850.42 query29 12.60 3.953.31 query30 0.240.090.06 query31 2.830.580.39 query32 3.230.570.46 query33 3.033.043.05 query34 15.72 5.114.43 query35 4.504.514.49 query36 0.700.490.48 query37 0.080.060.07 query38 0.050.040.04 query39 0.040.020.02 query40 0.160.130.13 query41 0.080.020.02 query42 0.040.020.02 query43 0.030.030.02 Total cold run time: 105.63 s Total hot run time: 30.98 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](restore) Link existing rowset files bidirectionally [doris]
wyxxxcat commented on PR #49233: URL: https://github.com/apache/doris/pull/49233#issuecomment-2740918528 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](pipeline) set operator should use local state expr [doris]
hello-stephen commented on PR #49326: URL: https://github.com/apache/doris/pull/49326#issuecomment-2740212705 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](compile)Fix FE compile for #49283 [doris]
hello-stephen commented on PR #49327: URL: https://github.com/apache/doris/pull/49327#issuecomment-2740223978 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49292-branch-2.1 deleted (was 3f9e989d054)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49292-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git was 3f9e989d054 branch-2.1: [fix](arrow-flight-sql) Fix fetch_arrow_flight_schema thread pool (#49291) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large [doris]
doris-robot commented on PR #48887: URL: https://github.com/apache/doris/pull/48887#issuecomment-2739078056 TPC-DS: Total hot run time: 192356 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 6592ea6b0c810509916f024dff4f2ad2346fef66, data reload: false query1 1386106810581058 query2 6057190318741874 query3 11009 469443394339 query4 52684 24467 23474 23474 query5 5153546 460 460 query6 338 202 176 176 query7 4927504 301 301 query8 312 246 224 224 query9 6096259526342595 query10 432 319 265 265 query11 15227 15425 14919 14919 query12 158 112 108 108 query13 1064519 395 395 query14 10585 687964986498 query15 219 195 173 173 query16 7063698 502 502 query17 1088722 588 588 query18 1556428 330 330 query19 211 196 179 179 query20 129 130 120 120 query21 213 128 109 109 query22 4399460144094409 query23 33906 33793 33458 33458 query24 5802240024232400 query25 445 459 415 415 query26 738 276 171 171 query27 2007489 341 341 query28 2919244424102410 query29 608 556 427 427 query30 274 226 192 192 query31 866 852 818 818 query32 69 65 62 62 query33 465 372 344 344 query34 771 858 544 544 query35 800 836 764 764 query36 962 1004897 897 query37 123 107 75 75 query38 4227442841444144 query39 1488143514291429 query40 215 124 105 105 query41 52 52 51 51 query42 124 109 107 107 query43 523 529 497 497 query44 1360821 832 821 query45 184 174 165 165 query46 853 1029646 646 query47 1793184417741774 query48 404 430 338 338 query49 736 531 441 441 query50 728 775 427 427 query51 4435430542484248 query52 110 112 97 97 query53 249 267 202 202 query54 501 522 439 439 query55 87 85 84 84 query56 295 285 265 265 query57 1166122611261126 query58 253 240 255 240 query59 2677269224812481 query60 283 271 271 271 query61 125 117 124 117 query62 713 745 675 675 query63 225 189 186 186 query64 21671002687 687 query65 4409433343354333 query66 757 392 295 295 query67 15711 15769 15277 15277 query68 7316876 502 502 query69 543 299 270 270 query70 1193113110951095 query71 495 289 273 273 query72 5745374938583749 query73 1347760 346 346 query74 9030916189398939 query75 3843313427242724 query76 43871199762 762 query77 640 368 297 297 query78 10009 10104 92899289 query79 3097833 579 579 query80 767 525 444 444 query81 480 250 221 221 query82 549 132 98 98 query83 276 179 154 154 query84 282 90 79 79 query85 798 355 310 310 query86 354 311 279 279 query87 4661448744584458 query88 3146227222572257 query89 414 321 279 279 query90 1990219 227 219 query91 138 136 113 113 query92 72 60 54 54 query93 11931056581 581 query94 685 418 303 303 query95 358 277 259 259 query96 489 559 279 279 query97 3389338833123312 query98 218 199 201 199 query99 1418141112511251 Total cold run time: 297233 ms Total hot run time: 192356 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] branch-2.1: [fix](core) fix subreplace when inputting a large number of empty strings #49241 [doris]
yiguolei closed pull request #49303: branch-2.1: [fix](core) fix subreplace when inputting a large number of empty strings #49241 URL: https://github.com/apache/doris/pull/49303 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
doris.git: Error while running github feature from master:.asf.yaml
An error occurred while processing the github feature in .asf.yaml: while parsing a mapping in "doris.git/.asf.yaml::github", line 111, column 1: - Build Broker ^ (line: 111) unexpected key not in schema 'required_pull_request_reviews' in "doris.git/.asf.yaml::github", line 114, column 1: - COMPILE (DORIS_COMPILE) ^ (line: 114) --- With regards, ASF Infra. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [bugfix](be) split the usage of thread pool in internal service #49292 [doris]
Thearas commented on PR #49324: URL: https://github.com/apache/doris/pull/49324#issuecomment-2739971138 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
doris.git: Error while running github feature from auto-pick-49292-branch-3.0:.asf.yaml
An error occurred while processing the github feature in .asf.yaml: while parsing a mapping in "doris.git/.asf.yaml::github", line 72, column 1: - BE UT (Doris BE UT) ^ (line: 72) unexpected key not in schema 'required_pull_request_reviews' in "doris.git/.asf.yaml::github", line 75, column 1: required_pull_request_reviews: ^ (line: 75) --- With regards, ASF Infra. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [bugfix](be) split the usage of thread pool in internal service #49292 [doris]
dataroaring closed pull request #49324: branch-3.0: [bugfix](be) split the usage of thread pool in internal service #49292 URL: https://github.com/apache/doris/pull/49324 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](statistics)Remove read lock when doing db analyze. (#49250) [doris]
doris-robot commented on PR #49321: URL: https://github.com/apache/doris/pull/49321#issuecomment-2740165478 ClickBench: Total hot run time: 31.7 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit f6ded7a0cbbb79f2d169e99d773e1086bb7cae35, data reload: false query1 0.030.040.03 query2 0.060.030.02 query3 0.230.060.06 query4 1.620.100.10 query5 0.510.500.52 query6 1.130.730.73 query7 0.020.020.02 query8 0.040.050.03 query9 0.560.510.50 query10 0.540.540.54 query11 0.150.100.10 query12 0.140.110.11 query13 0.610.600.59 query14 2.732.862.76 query15 0.900.810.82 query16 0.380.390.41 query17 1.051.081.00 query18 0.230.220.22 query19 1.891.872.07 query20 0.010.010.01 query21 15.36 0.600.59 query22 2.421.871.75 query23 17.20 0.860.66 query24 3.080.701.78 query25 0.250.060.04 query26 0.580.140.13 query27 0.040.040.05 query28 10.01 0.470.46 query29 12.56 3.243.24 query30 0.260.070.05 query31 2.860.390.37 query32 3.250.450.45 query33 2.933.082.99 query34 17.04 4.494.50 query35 4.574.624.56 query36 0.670.490.49 query37 0.090.060.06 query38 0.040.030.03 query39 0.030.020.02 query40 0.160.130.12 query41 0.080.020.02 query42 0.030.030.02 query43 0.040.030.03 Total cold run time: 106.38 s Total hot run time: 31.7 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](function) fix error result in append_trailing_char_if_absent [doris]
Mryange closed pull request #49083: [fix](function) fix error result in append_trailing_char_if_absent URL: https://github.com/apache/doris/pull/49083 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](function) fix error result in url_encode [doris]
Mryange closed pull request #49063: [fix](function) fix error result in url_encode URL: https://github.com/apache/doris/pull/49063 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) fold constant for string function process emoji character by mistake [doris]
github-actions[bot] commented on PR #49087: URL: https://github.com/apache/doris/pull/49087#issuecomment-2740186154 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](function) fix error result when input utf8 in url_encode, strright, append_trailing_char_if_absent [doris]
Mryange commented on PR #49127: URL: https://github.com/apache/doris/pull/49127#issuecomment-2740184150 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
doris.git: Error while running github feature from auto-pick-49295-branch-3.0:.asf.yaml
An error occurred while processing the github feature in .asf.yaml: while parsing a mapping in "doris.git/.asf.yaml::github", line 72, column 1: - BE UT (Doris BE UT) ^ (line: 72) unexpected key not in schema 'required_pull_request_reviews' in "doris.git/.asf.yaml::github", line 75, column 1: required_pull_request_reviews: ^ (line: 75) --- With regards, ASF Infra. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](mow) remove rowset cache version #49295 [doris]
Thearas commented on PR #49322: URL: https://github.com/apache/doris/pull/49322#issuecomment-2739933820 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [don't merge] log for sc [doris]
hello-stephen commented on PR #49323: URL: https://github.com/apache/doris/pull/49323#issuecomment-2739964065 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
doris.git: Error while running github feature from main:.asf.yaml
An error occurred while processing the github feature in .asf.yaml: while parsing a mapping in "doris.git/.asf.yaml::github", line 72, column 1: - BE UT (Doris BE UT) ^ (line: 72) unexpected key not in schema 'required_pull_request_reviews' in "doris.git/.asf.yaml::github", line 75, column 1: required_pull_request_reviews: ^ (line: 75) --- With regards, ASF Infra. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [don't merge] log for sc [doris]
bobhan1 opened a new pull request, #49323: URL: https://github.com/apache/doris/pull/49323 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-49292-branch-3.0 created (now 8938f1d7de4)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-49292-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at 8938f1d7de4 [feature](cloud) Support rename compute group sql (#46221) (#48572) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](pipeline) Refactor state transition in pipeline task [doris]
yiguolei commented on code in PR #49281:
URL: https://github.com/apache/doris/pull/49281#discussion_r2005370488
##
be/src/pipeline/dependency.cpp:
##
@@ -68,32 +68,42 @@ void Dependency::set_ready() {
local_block_task.swap(_blocked_task);
}
for (auto* task : local_block_task) {
-task->wake_up();
+{
+std::unique_lock lc(_task_lock);
+DCHECK_EQ(task->_blocked_dep, this)
+<< "dep : " << debug_string(0) << "task: " <<
debug_string();
+task->_blocked_dep = nullptr;
+
THROW_IF_ERROR(task->_state_transition(PipelineTask::State::RUNNABLE));
+}
+task->wake_up(this);
}
}
-Dependency* Dependency::is_blocked_by(PipelineTask* task) {
+bool Dependency::is_blocked_by(PipelineTask* task) {
std::unique_lock lc(_task_lock);
auto ready = _ready.load();
if (!ready && task) {
_add_block_task(task);
+DCHECK_EQ(task->_blocked_dep, nullptr) << "task: " <<
task->debug_string();
+task->_blocked_dep = this;
Review Comment:
and here
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) fold constant for string function process emoji character by mistake [doris]
github-actions[bot] commented on PR #49087: URL: https://github.com/apache/doris/pull/49087#issuecomment-2740186423 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](pipeline) set operator should use local state expr [doris]
doris-robot commented on PR #49326: URL: https://github.com/apache/doris/pull/49326#issuecomment-2740350379 TPC-DS: Total hot run time: 193223 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 1a9560bea129dff27e067bbb28f3f995a244a811, data reload: false query1 1400108310371037 query2 6061192518391839 query3 10998 441343764376 query4 51858 25654 23204 23204 query5 5214591 478 478 query6 371 218 186 186 query7 4993502 272 272 query8 336 249 242 242 query9 6411261925972597 query10 428 318 262 262 query11 15209 15055 15020 15020 query12 174 111 103 103 query13 1115511 418 418 query14 10698 721063846384 query15 208 191 172 172 query16 7053640 493 493 query17 1067707 601 601 query18 1518407 301 301 query19 209 194 162 162 query20 141 119 122 119 query21 210 128 101 101 query22 4452457144324432 query23 34312 33162 33171 33162 query24 5775242524442425 query25 459 454 397 397 query26 686 295 149 149 query27 1738497 329 329 query28 2832245924662459 query29 583 559 420 420 query30 280 230 196 196 query31 895 851 790 790 query32 77 71 64 64 query33 478 401 316 316 query34 757 869 501 501 query35 818 887 762 762 query36 967 1036889 889 query37 130 104 80 80 query38 4180442040734073 query39 1495149214441444 query40 214 125 113 113 query41 59 57 57 57 query42 128 114 105 105 query43 514 492 486 486 query44 1349848 817 817 query45 197 181 174 174 query46 875 1030647 647 query47 1789194317721772 query48 383 419 302 302 query49 750 503 448 448 query50 724 743 419 419 query51 4267426742964267 query52 110 106 96 96 query53 229 266 180 180 query54 488 523 429 429 query55 84 83 91 83 query56 290 264 274 264 query57 1179117511271127 query58 252 238 295 238 query59 2678284828172817 query60 319 279 279 279 query61 151 127 124 124 query62 753 731 684 684 query63 224 184 184 184 query64 14721075697 697 query65 4542446443904390 query66 752 403 288 288 query67 15640 15642 15248 15248 query68 7159886 505 505 query69 546 301 262 262 query70 1212109810971097 query71 495 301 268 268 query72 5616514752205147 query73 1380643 338 338 query74 9118912488658865 query75 4044323927262726 query76 43821189783 783 query77 646 370 287 287 query78 10008 10176 92829282 query79 2620811 567 567 query80 678 525 428 428 query81 472 255 221 221 query82 577 125 95 95 query83 274 188 157 157 query84 289 101 82 82 query85 856 364 312 312 query86 337 300 283 283 query87 4451447243474347 query88 3353226422542254 query89 403 313 279 279 query90 1962208 217 208 query91 144 154 109 109 query92 71 60 59 59 query93 12271089581 581 query94 700 416 296 296 query95 351 280 272 272 query96 505 576 281 281 query97 3318341133493349 query98 232 210 204 204 query99 1453140712891289 Total cold run time: 295877 ms Total hot run time: 193223 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
Re: [PR] [feature](function) upper lower support utf8 input [doris]
github-actions[bot] commented on PR #49231: URL: https://github.com/apache/doris/pull/49231#issuecomment-2740352137 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Test](nereids) add UT for dropCached/Expired/StatsCommand in nereids [doris]
doris-robot commented on PR #49308: URL: https://github.com/apache/doris/pull/49308#issuecomment-2740363418 ClickBench: Total hot run time: 31.25 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit abf344f2edf33356b9c4f0831ba7f528cc091f9a, data reload: false query1 0.040.040.03 query2 0.130.100.10 query3 0.240.190.19 query4 1.590.190.20 query5 0.580.560.59 query6 1.200.730.72 query7 0.020.020.02 query8 0.050.030.03 query9 0.580.530.50 query10 0.570.600.55 query11 0.160.100.11 query12 0.140.110.11 query13 0.620.600.60 query14 2.822.702.80 query15 0.930.850.85 query16 0.390.380.38 query17 0.991.021.07 query18 0.210.190.20 query19 1.901.951.86 query20 0.020.020.01 query21 15.34 0.920.53 query22 0.761.230.67 query23 14.95 1.330.63 query24 6.761.860.91 query25 0.490.220.10 query26 0.610.150.13 query27 0.050.050.05 query28 10.10 0.870.44 query29 12.63 3.993.36 query30 0.250.100.06 query31 2.830.590.39 query32 3.280.550.46 query33 2.963.023.06 query34 15.83 5.174.51 query35 4.524.554.47 query36 0.690.520.49 query37 0.080.060.06 query38 0.040.040.04 query39 0.030.030.03 query40 0.180.130.14 query41 0.090.030.02 query42 0.030.020.02 query43 0.040.030.02 Total cold run time: 105.72 s Total hot run time: 31.25 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch master updated: [doc](load) optimize Pre-filtering doc (#2214)
This is an automated email from the ASF dual-hosted git repository.
liaoxin pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new 48d2ec015be [doc](load) optimize Pre-filtering doc (#2214)
48d2ec015be is described below
commit 48d2ec015be758292f2741f46c13d771f1006be7
Author: hui lai <1353307...@qq.com>
AuthorDate: Thu Mar 20 19:19:02 2025 +0800
[doc](load) optimize Pre-filtering doc (#2214)
---
docs/data-operate/import/load-data-convert.md | 71 -
.../data-operate/import/load-data-convert.md | 72 +-
.../data-operate/import/load-data-convert.md | 72 +-
.../data-operate/import/load-data-convert.md | 72 +-
.../data-operate/import/load-data-convert.md | 71 -
.../data-operate/import/load-data-convert.md | 71 -
6 files changed, 423 insertions(+), 6 deletions(-)
diff --git a/docs/data-operate/import/load-data-convert.md
b/docs/data-operate/import/load-data-convert.md
index d7b29d696ab..386b2ad5b6a 100644
--- a/docs/data-operate/import/load-data-convert.md
+++ b/docs/data-operate/import/load-data-convert.md
@@ -619,7 +619,18 @@ Scenarios where filtering is needed before column mapping
and transformation, al
For example, source data contains multiple tables' data (or multiple tables'
data is written to the same Kafka message queue). Each row of data has a column
indicating which table the data belongs to. Users can use pre-filtering
conditions to filter out the corresponding table data for loading.
-### Example
+Pre-filtering has the following limitations:
+- Column filtering restrictions
+
+Pre-filtering can only filter independent simple columns in the column list
and cannot filter columns with expressions. For example: when the column
mapping is (a, tmp, b = tmp + 1), column b cannot be used as a filter condition.
+
+- Data processing restrictions
+
+Pre-filtering occurs before data transformation, using raw data values for
comparison, and raw data is treated as string type. For example: for data like
`\N`, it will be compared directly as the `\N` string, rather than being
converted to NULL before comparison.
+
+### Example 1: Using Numeric Conditions for Pre-filtering
+
+This example demonstrates how to filter source data using simple numeric
comparison conditions. By setting the filter condition k1 > 1, we can filter
out unwanted records before data transformation.
Suppose we have the following source data (column names are for illustration
purposes only, and there is no actual header):
```plain
@@ -683,6 +694,64 @@ mysql> select * from example_table;
+--+--+---+--+
```
+### Example 2: Using Intermediate Columns to Filter Invalid Data
+
+This example demonstrates how to handle data import scenarios containing
invalid data.
+
+Source data:
+```plain text
+1,1
+2,abc
+3,3
+```
+
+ Table Creation
+```sql
+CREATE TABLE example_table
+(
+k1 INT,
+k2 INT NOT NULL
+)
+ENGINE = OLAP
+DUPLICATE KEY(k1)
+DISTRIBUTED BY HASH(k1) BUCKETS 1;
+```
+
+For column k2, which is of type INT, `abc` is invalid dirty data. To filter
this data, we can introduce an intermediate column for filtering.
+
+ Load Statements
+- Broker Load
+```sql
+LOAD LABEL example_db.label1
+(
+DATA INFILE("s3://bucket_name/data.csv")
+INTO TABLE example_table
+COLUMNS TERMINATED BY ","
+(k1, tmp, k2 = tmp)
+PRECEDING FILTER tmp != "abc"
+)
+WITH s3 (...);
+```
+
+- Routine Load
+```sql
+CREATE ROUTINE LOAD example_db.example_routine_load ON example_table
+COLUMNS(k1, tmp, k2 = tmp),
+COLUMNS TERMINATED BY ","
+PRECEDING FILTER tmp != "abc"
+FROM KAFKA (...);
+```
+
+ Load Results
+```sql
+mysql> select * from example_table;
++--++
+| k1 | k2 |
++--++
+|1 | 1 |
+|3 | 3 |
++--++
+```
## Post-filtering
diff --git
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/load-data-convert.md
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/load-data-convert.md
index 1e9c4d2263e..f789741df3e 100644
---
a/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/load-data-convert.md
+++
b/i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/load-data-convert.md
@@ -606,7 +606,19 @@ mysql> select * from example_table;
比如源数据中存储了多张表的数据（或者多张表的数据写入了同一个 Kafka
消息队列）。数据中每行有一列表名来标识该行数据属于哪个表。用户可以通过前置过滤条件来筛选对应的表数据进行导入。
-### 示例
+前置过滤有以下限制：
+- 过滤列限制。
+
+前置过滤只能对列表中的独立简单列进行过滤，无法对带有表达式的列进行过滤。如：在列映射为（a, tmp, b = tmp + 1）时，b 列无法作为过滤条件。
+
+- 数据处理限制
+
+前置过滤发生在数据转换之前，使用原始数据值进行比较，原始数据会视为字符串类型。如：对于 `\N` 这样的数据，会直接用 `\N`
字符串进行比较，而不会转换为 NULL 后再比较。
+
+### 示例一：使用数值条件进行前置过滤
+
+本示例展示如何使用简单的数值比较条件来过滤源数据。通过设置 k1 > 1 的过滤条件，实现在数据转换前过滤掉不需要的记录。
+
假设有以下源数据（表头列名仅为方便表述，实际并无表头）：
```plain
列 1，列 2，列 3，
Re: [PR] [refactor](pipeline) Refactor state transition in pipeline task [doris]
yiguolei commented on code in PR #49281:
URL: https://github.com/apache/doris/pull/49281#discussion_r2005375842
##
be/src/pipeline/dependency.cpp:
##
@@ -68,32 +68,42 @@ void Dependency::set_ready() {
local_block_task.swap(_blocked_task);
}
for (auto* task : local_block_task) {
-task->wake_up();
+{
+std::unique_lock lc(_task_lock);
+DCHECK_EQ(task->_blocked_dep, this)
+<< "dep : " << debug_string(0) << "task: " <<
debug_string();
+task->_blocked_dep = nullptr;
+
THROW_IF_ERROR(task->_state_transition(PipelineTask::State::RUNNABLE));
+}
+task->wake_up(this);
}
}
-Dependency* Dependency::is_blocked_by(PipelineTask* task) {
+bool Dependency::is_blocked_by(PipelineTask* task) {
std::unique_lock lc(_task_lock);
auto ready = _ready.load();
if (!ready && task) {
_add_block_task(task);
+DCHECK_EQ(task->_blocked_dep, nullptr) << "task: " <<
task->debug_string();
+task->_blocked_dep = this;
+start_watcher();
+THROW_IF_ERROR(task->_state_transition(PipelineTask::State::BLOCKED));
}
-return ready ? nullptr : this;
+return !ready;
}
-Dependency* QueryGlobalDependency::is_blocked_by(PipelineTask* task) {
+bool QueryGlobalDependency::is_blocked_by(PipelineTask* task) {
if (task && task->wake_up_early()) {
Review Comment:
而且这种逻辑就很诡异，为什么只有QueryGlobalDependency 需要感知的到wakeup early，而不是所有的dependency
都感知呢？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [doc](load) optimize Pre-filtering doc [doris-website]
liaoxin01 merged PR #2214: URL: https://github.com/apache/doris-website/pull/2214 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (d01955346e5 -> 3b092bdc158)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard d01955346e5 Automated deployment with doris branch @ cf1f88808c7b84e89b75d0b65c3a26829b7ae7c9 new 3b092bdc158 Automated deployment with doris branch @ cf1f88808c7b84e89b75d0b65c3a26829b7ae7c9 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (d01955346e5) \ N -- N -- N refs/heads/asf-site (3b092bdc158) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](test) [doris]
zhangstar333 closed pull request #47171: [test](test) URL: https://github.com/apache/doris/pull/47171 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](mow) remove rowset cache version #49295 [doris]
doris-robot commented on PR #49322: URL: https://github.com/apache/doris/pull/49322#issuecomment-2740254195 # BE UT Coverage Report Increment line coverage `31.37% (16/51)` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/a36813e0a5b8edb86852ced73cd468593aa8d01a_a36813e0a5b8edb86852ced73cd468593aa8d01a/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/a36813e0a5b8edb86852ced73cd468593aa8d01a_a36813e0a5b8edb86852ced73cd468593aa8d01a/report/index.html) | Category | Coverage | |---|| | Function Coverage | 38.89% (10173/26158) | | Line Coverage | 30.32% (86797/286281) | | Region Coverage | 29.36% (44583/151857) | | Branch Coverage | 25.88% (22677/87626) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](function) fix error result when input utf8 in url_encode, strright, append_trailing_char_if_absent [doris]
doris-robot commented on PR #49127: URL: https://github.com/apache/doris/pull/49127#issuecomment-2740264572 TPC-H: Total hot run time: 34030 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit aec8d41843779e095ea6b8bc1036c5f11631b347, data reload: false -- Round 1 -- q1 23936 504450135013 q2 2052287 164 164 q3 10423 1226662 662 q4 10226 995 525 525 q5 7834239923662366 q6 273 161 133 133 q7 916 759 615 615 q8 9309126710091009 q9 7542513751535137 q10 6858233818821882 q11 483 281 264 264 q12 347 356 216 216 q13 17799 370630853085 q14 237 229 208 208 q15 554 483 485 483 q16 626 628 586 586 q17 571 868 330 330 q18 7928719571617161 q19 1520966 550 550 q20 313 334 211 211 q21 3866343224692469 q22 10541023961 961 Total cold run time: 114667 ms Total hot run time: 34030 ms - Round 2, with runtime_filter_mode=off - q1 5216511751415117 q2 234 339 236 236 q3 2120267523162316 q4 1410183313841384 q5 4547446344294429 q6 217 165 123 123 q7 1960189417341734 q8 2581262425762576 q9 7291709971677099 q10 3008320627572757 q11 563 517 499 499 q12 678 771 611 611 q13 3564391432383238 q14 292 286 271 271 q15 523 472 473 472 q16 648 702 644 644 q17 1139164713201320 q18 7645753174517451 q19 792 806 853 806 q20 1932199818321832 q21 5297481546474647 q22 10691033971 971 Total cold run time: 52726 ms Total hot run time: 50533 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [feat](binlog) Add config to control whether enable persistent connec… #48761 [doris]
doris-robot commented on PR #49006: URL: https://github.com/apache/doris/pull/49006#issuecomment-2736386506 # BE UT Coverage Report Increment line coverage ` ` :tada: [Increment coverage report](http://coverage.selectdb-in.cc/coverage/f723468353a2b107e04546f1eb06d21bb66f5fb5_f723468353a2b107e04546f1eb06d21bb66f5fb5/increment_report/index.html) [Complete coverage report](http://coverage.selectdb-in.cc/coverage/f723468353a2b107e04546f1eb06d21bb66f5fb5_f723468353a2b107e04546f1eb06d21bb66f5fb5/report/index.html) | Category | Coverage | |---|| | Function Coverage | 38.88% (10168/26154) | | Line Coverage | 30.31% (86710/286090) | | Region Coverage | 29.36% (44548/151734) | | Branch Coverage | 25.88% (22653/87546) | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](compaction) fix compaction check on variant [doris]
Thearas commented on PR #49328: URL: https://github.com/apache/doris/pull/49328#issuecomment-2740268645 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](compaction) fix compaction check on variant [doris]
csun5285 opened a new pull request, #49328: URL: https://github.com/apache/doris/pull/49328 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix] (nereids) Fix incorrect "hive" references in LogicalIcebergTableSink and update PlanType [doris]
morningman commented on PR #49306: URL: https://github.com/apache/doris/pull/49306#issuecomment-2740512728 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](pipeline) set operator should use local state expr [doris]
doris-robot commented on PR #49326: URL: https://github.com/apache/doris/pull/49326#issuecomment-2740364010 ClickBench: Total hot run time: 31.09 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 1a9560bea129dff27e067bbb28f3f995a244a811, data reload: false query1 0.040.040.03 query2 0.120.110.10 query3 0.250.180.18 query4 1.590.190.20 query5 0.590.570.59 query6 1.170.730.71 query7 0.030.010.02 query8 0.050.030.04 query9 0.570.530.52 query10 0.590.580.57 query11 0.160.110.11 query12 0.140.110.11 query13 0.620.590.60 query14 2.732.742.71 query15 0.940.850.86 query16 0.390.390.37 query17 1.051.041.07 query18 0.210.190.20 query19 1.891.841.88 query20 0.010.010.01 query21 15.37 0.920.54 query22 0.751.200.63 query23 14.96 1.350.61 query24 6.892.120.86 query25 0.490.180.14 query26 0.660.150.14 query27 0.050.050.05 query28 9.790.840.42 query29 12.55 3.993.29 query30 0.250.090.07 query31 2.820.600.38 query32 3.230.540.47 query33 2.982.983.03 query34 15.73 5.054.50 query35 4.544.494.52 query36 0.660.490.48 query37 0.090.070.06 query38 0.050.040.04 query39 0.020.020.02 query40 0.180.130.13 query41 0.080.020.02 query42 0.030.020.02 query43 0.040.030.02 Total cold run time: 105.35 s Total hot run time: 31.09 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](restore) correct the storage_medium of atomic restore [doris]
w41ter opened a new pull request, #49330: URL: https://github.com/apache/doris/pull/49330 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: If the replica nums are not equal between the local and the remote table, the storage_medium will be set to HDD in the previous implementation, which causes the make_snapshot task to fail if the target replicas are migrated to another disk. This PR uses the storage_medium from the partition info as the new replicas's storage_medium, to avoid disk storage_medium migration. ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [x] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](restore) correct the storage_medium of atomic restore [doris]
hello-stephen commented on PR #49330: URL: https://github.com/apache/doris/pull/49330#issuecomment-2740531147 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Test](nereids) Add ut for alter column/table stats command in nereids [doris]
yx-keith commented on PR #49278: URL: https://github.com/apache/doris/pull/49278#issuecomment-2740526057 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](Compaction) Add cumulative compaction delay strategy [doris]
Yukang-Lian commented on PR #48759: URL: https://github.com/apache/doris/pull/48759#issuecomment-2741338971 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
