[PR] [ci](fix) adjust GITHUB_TOKEN permissions [doris]
hello-stephen opened a new pull request, #39553:
URL: https://github.com/apache/doris/pull/39553
when pr needs to skip the TeamCity build, an error occurs like below，
```
curl -L -X POST -H 'Accept: application/vnd.github+json' -H 'Authorization:
***' -H 'X-GitHub-Api-Version: 2022-11-28'
https://api.github.com/repos/apache/doris/statuses/efa07c9ec476b4841bace614df58a98e62d22176
-d '{"state":"success","target_url":"","description":"Skip teamCity
build","context":"FE UT (Doris FE UT)"}'
{
"message": "Resource not accessible by integration",
"documentation_url":
"https://docs.github.com/rest/commits/statuses#create-a-commit-status";,
"status": "403"
}
```
it seems that GITHUB_TOKEN has changed the default permission.
According to the document
https://docs.github.com/zh/actions/writing-workflows/workflow-syntax-for-github-actions#permissions,
I try to set the required permission to fix this problem.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [ci](fix) adjust GITHUB_TOKEN permissions [doris]
doris-robot commented on PR #39553: URL: https://github.com/apache/doris/pull/39553#issuecomment-2295809768 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](arm) Optimize the BlockBloomFilter::bucket_find on ARM platforms using NEON instructions. [doris]
github-actions[bot] commented on PR #3: URL: https://github.com/apache/doris/pull/3#issuecomment-2295809984 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv)use name instead of id in meta of MTMV [doris]
zddr commented on PR #39355: URL: https://github.com/apache/doris/pull/39355#issuecomment-2295809897 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](Load)only check partitions' state in loading process, instead of checking table state [doris]
Johnnyssc commented on PR #39411: URL: https://github.com/apache/doris/pull/39411#issuecomment-2295810060 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](arm) Optimize the BlockBloomFilter::bucket_find on ARM platforms using NEON instructions. [doris]
github-actions[bot] commented on PR #3: URL: https://github.com/apache/doris/pull/3#issuecomment-2295810041 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Nereids) support drop statement syntax in Nereids [doris]
doris-robot commented on PR #39506: URL: https://github.com/apache/doris/pull/39506#issuecomment-2295811093 TPC-H: Total hot run time: 38029 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit a0542f733c00ffe59c36decb3ad6ae598b0e9cad, data reload: false -- Round 1 -- q1 17851 444242944294 q2 2060213 205 205 q3 11734 105311621053 q4 10536 774 704 704 q5 7762286028262826 q6 263 157 155 155 q7 1014652 666 652 q8 9602209721122097 q9 8820657565786575 q10 7059223621932193 q11 483 271 269 269 q12 431 253 255 253 q13 17795 301529972997 q14 303 266 259 259 q15 555 544 514 514 q16 514 406 404 404 q17 979 734 722 722 q18 7491677866576657 q19 6923106411051064 q20 714 345 337 337 q21 4188279328722793 q22 1113103510061006 Total cold run time: 118190 ms Total hot run time: 38029 ms - Round 2, with runtime_filter_mode=off - q1 4550437043384338 q2 410 307 310 307 q3 2881258327412583 q4 2031175917221722 q5 5625575656475647 q6 244 146 143 143 q7 2185176317881763 q8 3376350335003500 q9 8868876688488766 q10 3622330632963296 q11 639 543 533 533 q12 832 668 636 636 q13 16822 308030863080 q14 344 312 304 304 q15 571 551 530 530 q16 516 470 461 461 q17 1842156715271527 q18 8371780977507750 q19 5427161414791479 q20 2178190818871887 q21 13704 529853545298 q22 1172108610851085 Total cold run time: 86210 ms Total hot run time: 56635 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [ci](fix) adjust GITHUB_TOKEN permissions [doris]
hello-stephen commented on PR #39553: URL: https://github.com/apache/doris/pull/39553#issuecomment-2295812229 skip buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Refactor](inverted index) refactor inverted index compound predicates evaluate logic [doris]
airborne12 commented on PR #38908: URL: https://github.com/apache/doris/pull/38908#issuecomment-2295812415 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](inverted index) add test for need read data opt (#38261) [doris]
airborne12 commented on PR #39534: URL: https://github.com/apache/doris/pull/39534#issuecomment-2295814761 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](http) fix http url with incorrect character notation (#38420) [doris]
airborne12 merged PR #39535: URL: https://github.com/apache/doris/pull/39535 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix] (inverted index) remove tmp columns in block (#39369) [doris]
airborne12 commented on PR #39533: URL: https://github.com/apache/doris/pull/39533#issuecomment-2295813570 run feut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: [fix](http) fix http url with incorrect character notation (#38420) (#39535)
This is an automated email from the ASF dual-hosted git repository.
airborne pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new fb17f204d7a [fix](http) fix http url with incorrect character notation
(#38420) (#39535)
fb17f204d7a is described below
commit fb17f204d7ae5e41d410e252e3e401bc4619e0b9
Author: Sun Chenyang
AuthorDate: Mon Aug 19 15:03:19 2024 +0800
[fix](http) fix http url with incorrect character notation (#38420) (#39535)
## Proposed changes
pick from master #38420
---
be/src/http/http_client.cpp| 60 ++-
be/src/http/http_client.h | 9 +++
be/src/olap/single_replica_compaction.cpp | 15 +
be/src/olap/task/engine_clone_task.cpp | 20 +--
be/test/http/http_client_test.cpp | 42 ++
.../suites/load_p2/test_single_replica_load.groovy | 67 ++
6 files changed, 179 insertions(+), 34 deletions(-)
diff --git a/be/src/http/http_client.cpp b/be/src/http/http_client.cpp
index 218802878bd..e94614788f5 100644
--- a/be/src/http/http_client.cpp
+++ b/be/src/http/http_client.cpp
@@ -131,8 +131,11 @@ Status HttpClient::init(const std::string& url, bool
set_fail_on_error) {
LOG(WARNING) << "fail to set CURLOPT_WRITEDATA, msg=" <<
_to_errmsg(code);
return Status::InternalError("fail to set CURLOPT_WRITEDATA");
}
+
+std::string escaped_url;
+RETURN_IF_ERROR(_escape_url(url, &escaped_url));
// set url
-code = curl_easy_setopt(_curl, CURLOPT_URL, url.c_str());
+code = curl_easy_setopt(_curl, CURLOPT_URL, escaped_url.c_str());
if (code != CURLE_OK) {
LOG(WARNING) << "failed to set CURLOPT_URL, errmsg=" <<
_to_errmsg(code);
return Status::InternalError("fail to set CURLOPT_URL");
@@ -290,4 +293,59 @@ Status HttpClient::execute_with_retry(int retry_times, int
sleep_time,
return status;
}
+// http://example.com/page?param1=value1¶m2=value+with+spaces#section
+Status HttpClient::_escape_url(const std::string& url, std::string*
escaped_url) {
+size_t query_pos = url.find('?');
+if (query_pos == std::string::npos) {
+*escaped_url = url;
+return Status::OK();
+}
+size_t fragment_pos = url.find('#');
+std::string query;
+std::string fragment;
+
+if (fragment_pos == std::string::npos) {
+query = url.substr(query_pos + 1, url.length() - query_pos - 1);
+} else {
+query = url.substr(query_pos + 1, fragment_pos - query_pos - 1);
+fragment = url.substr(fragment_pos, url.length() - fragment_pos);
+}
+
+std::string encoded_query;
+size_t ampersand_pos = query.find('&');
+size_t equal_pos;
+
+if (ampersand_pos == std::string::npos) {
+ampersand_pos = query.length();
+}
+
+while (true) {
+equal_pos = query.find('=');
+if (equal_pos != std::string::npos) {
+std::string key = query.substr(0, equal_pos);
+std::string value = query.substr(equal_pos + 1, ampersand_pos -
equal_pos - 1);
+
+auto encoded_value = std::unique_ptr(
+curl_easy_escape(_curl, value.c_str(), value.length()),
&curl_free);
+if (encoded_value) {
+encoded_query += key + "=" + std::string(encoded_value.get());
+} else {
+return Status::InternalError("escape url failed, url={}", url);
+}
+} else {
+encoded_query += query.substr(0, ampersand_pos);
+}
+
+if (ampersand_pos == query.length() || ampersand_pos ==
std::string::npos) {
+break;
+}
+
+encoded_query += "&";
+query = query.substr(ampersand_pos + 1);
+ampersand_pos = query.find('&');
+}
+*escaped_url = url.substr(0, query_pos + 1) + encoded_query + fragment;
+return Status::OK();
+}
+
} // namespace doris
diff --git a/be/src/http/http_client.h b/be/src/http/http_client.h
index 9659de13cfc..f6a1a17ec29 100644
--- a/be/src/http/http_client.h
+++ b/be/src/http/http_client.h
@@ -146,6 +146,15 @@ public:
size_t on_response_data(const void* data, size_t length);
+// The file name of the variant column with the inverted index contains %
+// such as:
023f624c4c322c568271060f9b5b274a4a95_0_10133@properties%2Emessage.idx
+//
{rowset_id}_{seg_num}_{index_id}_{variant_column_name}{%2E}{extracted_column_name}.idx
+// We need to handle %, otherwise it will cause an HTTP 404 error.
+// Because the percent ("%") character serves as the indicator for
percent-encoded octets,
+// it must be percent-encoded as "%25" for that octet to be used as data
within a URI.
+// https://datatracker.ietf.org/doc/html/rfc3986
+Status _escape_url(const std::string& url, std::string*
Re: [PR] [fix] (inverted index) remove tmp columns in block (#39369) [doris]
airborne12 commented on PR #39533: URL: https://github.com/apache/doris/pull/39533#issuecomment-2295815224 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](Load)only check partitions' state in loading process, instead of checking table state [doris]
doris-robot commented on PR #39411: URL: https://github.com/apache/doris/pull/39411#issuecomment-2295816582 TPC-H: Total hot run time: 50293 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 208203b98daf8609c8b89473755dc9b1939aa3fc, data reload: false -- Round 1 -- q1 18319 444543714371 q2 2081197 184 184 q3 10194 190119291901 q4 10381 127413511274 q5 8643426139493949 q6 276 145 141 141 q7 2088162216291622 q8 9537276527412741 q9 13556 10387 10136 10136 q10 8665353334823482 q11 447 273 277 273 q12 509 331 328 328 q13 18434 401741324017 q14 402 369 362 362 q15 554 505 512 505 q16 727 637 639 637 q17 1162977 935 935 q18 7463700469426942 q19 2004165715411541 q20 549 331 328 328 q21 4507419641884188 q22 519 436 459 436 Total cold run time: 121017 ms Total hot run time: 50293 ms - Round 2, with runtime_filter_mode=off - q1 4403439544004395 q2 366 268 264 264 q3 4208421241854185 q4 2799279827832783 q5 7208725071557155 q6 258 142 134 134 q7 3327305930463046 q8 4591474647114711 q9 17373 17070 16906 16906 q10 4315432543194319 q11 800 722 707 707 q12 1062854 902 854 q13 7276377737523752 q14 492 442 460 442 q15 547 498 522 498 q16 772 732 710 710 q17 3849391738713871 q18 8804882988698829 q19 1779179117201720 q20 2423217121472147 q21 8574857685478547 q22 1060998 949 949 Total cold run time: 86286 ms Total hot run time: 80924 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Var nested [doris]
eldenmoon commented on PR #39022: URL: https://github.com/apache/doris/pull/39022#issuecomment-2295820284 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement]use awaitility.await() in schema testcases #37817 [doris]
xinyiZzz commented on PR #38869: URL: https://github.com/apache/doris/pull/38869#issuecomment-2295822605 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement]use awaitility.await() add in variant and schema testcase [doris]
xinyiZzz commented on PR #38836: URL: https://github.com/apache/doris/pull/38836#issuecomment-2295823110 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](statistics)Support enable/disable auto analyze for table. [doris]
doris-robot commented on PR #39532: URL: https://github.com/apache/doris/pull/39532#issuecomment-2295829127 TPC-H: Total hot run time: 38149 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 684d4e02627d7ac2e3f1f0d6da726b80be3cd606, data reload: false -- Round 1 -- q1 17850 434342774277 q2 2054210 201 201 q3 11827 992 1171992 q4 10528 754 718 718 q5 7790287028602860 q6 272 157 156 156 q7 1025667 642 642 q8 9588209621112096 q9 8613654066196540 q10 7065225322822253 q11 477 268 274 268 q12 429 256 253 253 q13 18965 298829802980 q14 302 255 259 255 q15 572 520 527 520 q16 518 409 399 399 q17 983 598 742 598 q18 7307682567576757 q19 6450103310921033 q20 711 349 345 345 q21 3888306729902990 q22 1093103510161016 Total cold run time: 118307 ms Total hot run time: 38149 ms - Round 2, with runtime_filter_mode=off - q1 4664432143314321 q2 408 311 303 303 q3 2896263327332633 q4 1966170617111706 q5 5662569056305630 q6 245 145 149 145 q7 2147179417501750 q8 3299353834693469 q9 8812880988068806 q10 3608331332743274 q11 625 537 530 530 q12 842 704 670 670 q13 16930 320330823082 q14 321 286 308 286 q15 564 531 525 525 q16 510 466 480 466 q17 1811158715501550 q18 8200780676557655 q19 7395158215771577 q20 2149188018741874 q21 13888 538353015301 q22 1149105210821052 Total cold run time: 88091 ms Total hot run time: 56605 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](scan) fix predicate contains cast that results in null, the predicate will be miss. [doris]
doris-robot commented on PR #39550: URL: https://github.com/apache/doris/pull/39550#issuecomment-2295830748 TPC-H: Total hot run time: 38061 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit a018d0d595b2614b08324360ad4649ce68a9f573, data reload: false -- Round 1 -- q1 17854 437243184318 q2 2048220 222 220 q3 11817 931 1131931 q4 10524 704 693 693 q5 7773285928322832 q6 263 158 158 158 q7 1014662 681 662 q8 9619212321602123 q9 8764661365436543 q10 7099222622512226 q11 486 271 270 270 q12 421 261 256 256 q13 17793 303730473037 q14 299 252 267 252 q15 564 532 527 527 q16 528 426 411 411 q17 985 682 699 682 q18 7309678467436743 q19 7243104910061006 q20 865 357 365 357 q21 4397276827732768 q22 1146104610751046 Total cold run time: 118811 ms Total hot run time: 38061 ms - Round 2, with runtime_filter_mode=off - q1 4468432142724272 q2 412 319 322 319 q3 2838262528082625 q4 1978171416661666 q5 5638571156345634 q6 243 154 149 149 q7 2139178918251789 q8 3273352534263426 q9 8830878587938785 q10 3618337032823282 q11 615 530 524 524 q12 831 683 650 650 q13 17247 325430443044 q14 326 297 285 285 q15 554 514 508 508 q16 522 459 468 459 q17 1820157515421542 q18 8268780776617661 q19 9639179815931593 q20 2193192418651865 q21 13630 533252465246 q22 1230109711051097 Total cold run time: 90312 ms Total hot run time: 56421 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Nereids) support drop statement syntax in Nereids [doris]
doris-robot commented on PR #39506: URL: https://github.com/apache/doris/pull/39506#issuecomment-2295831635 TPC-DS: Total hot run time: 196647 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit a0542f733c00ffe59c36decb3ad6ae598b0e9cad, data reload: false query1 1331916 879 879 query2 6707196519511951 query3 10661 385538933855 query4 57351 24251 23237 23237 query5 6194724 734 724 query6 546 210 216 210 query7 6451321 323 321 query8 551 445 440 440 query9 9355251625102510 query10 628 348 338 338 query11 18624 15106 15342 15106 query12 199 151 148 148 query13 1711435 428 428 query14 12354 719373127193 query15 263 194 197 194 query16 7942477 513 477 query17 1210651 615 615 query18 2341346 344 344 query19 322 171 169 169 query20 145 137 142 137 query21 266 149 143 143 query22 4412439443984394 query23 34470 33820 33870 33820 query24 5645304930343034 query25 583 424 424 424 query26 732 185 180 180 query27 1884306 301 301 query28 3589211620902090 query29 771 442 441 441 query30 218 181 180 180 query31 1026858 819 819 query32 127 75 79 75 query33 557 345 339 339 query34 889 490 494 490 query35 871 773 758 758 query36 1077947 944 944 query37 156 101 103 101 query38 3947389838463846 query39 1537148814721472 query40 239 157 155 155 query41 139 138 136 136 query42 137 116 123 116 query43 542 514 500 500 query44 1103793 770 770 query45 228 197 194 194 query46 1113775 759 759 query47 1925184818731848 query48 407 347 331 331 query49 925 580 576 576 query50 861 454 469 454 query51 6895686268296829 query52 120 108 117 108 query53 296 224 225 224 query54 608 524 498 498 query55 88 86 86 86 query56 328 306 325 306 query57 1223110111481101 query58 299 298 309 298 query59 2921278327852783 query60 350 327 325 325 query61 150 145 148 145 query62 799 676 694 676 query63 253 227 227 227 query64 4386234540132345 query65 3254321932213219 query66 1059668 677 668 query67 15192 14996 14865 14865 query68 5088569 581 569 query69 554 316 311 311 query70 1159107111561071 query71 551 312 317 312 query72 7432228620352035 query73 794 349 352 349 query74 9183894689588946 query75 3827277127132713 query76 3279103910291029 query77 648 441 435 435 query78 9813918891409140 query79 3499552 545 545 query80 2849606 603 603 query81 607 260 260 260 query82 779 162 154 154 query83 378 217 212 212 query84 301 94 103 94 query85 1330358 355 355 query86 466 324 318 318 query87 4317432642674267 query88 5103248024552455 query89 445 324 322 322 query90 2014235 234 234 query91 160 128 127 127 query92 85 75 76 75 query93 5164555 539 539 query94 932 328 325 325 query95 399 295 292 292 query96 622 288 284 284 query97 3272308830913088 query98 248 232 223 223 query99 1765129613101296 Total cold run time: 330546 ms Total hot run time: 196647 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to
Re: [PR] [Enhancement]use awaitility.await() in schema testcases #37817 [doris]
github-actions[bot] commented on PR #38869: URL: https://github.com/apache/doris/pull/38869#issuecomment-2295833516 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement]use awaitility.await() in schema testcases #37817 [doris]
github-actions[bot] commented on PR #38869: URL: https://github.com/apache/doris/pull/38869#issuecomment-2295833582 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](scan) fix predicate contains cast that results in null, the predicate will be miss. [doris]
yiguolei commented on code in PR #39550:
URL: https://github.com/apache/doris/pull/39550#discussion_r1721315157
##
be/src/pipeline/exec/scan_operator.cpp:
##
@@ -708,7 +708,9 @@ Status
ScanLocalState::_should_push_down_binary_predicate(
std::shared_ptr const_col_wrapper;
RETURN_IF_ERROR(children[1 - i]->get_const_col(expr_ctx,
&const_col_wrapper));
if (const auto* const_column =
check_and_get_column(
-const_col_wrapper->column_ptr)) {
+const_col_wrapper->column_ptr);
Review Comment:
add check at line 721 to throw exception when ACCEPTABLE && constant_val ==
null
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](scan) fix predicate contains cast that results in null, the predicate will be miss. [doris]
yiguolei commented on code in PR #39550:
URL: https://github.com/apache/doris/pull/39550#discussion_r1721318750
##
regression-test/suites/correctness/test_scan_with_cast_null_value.groovy:
##
@@ -0,0 +1,38 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+suite("test_scan_with_cast_null_value") {
Review Comment:
加一些测试枚举一下情况的组合：
1. 能push down operator的组合，比如 = > < >= <=
2. 常量可能产出结果为null的组合，比如cast
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](Nereids) support drop statement syntax in Nereids [doris]
doris-robot commented on PR #39506: URL: https://github.com/apache/doris/pull/39506#issuecomment-2295840764 ClickBench: Total hot run time: 30.57 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit a0542f733c00ffe59c36decb3ad6ae598b0e9cad, data reload: false query1 0.060.050.04 query2 0.070.050.05 query3 0.230.050.06 query4 1.660.070.07 query5 0.500.480.49 query6 1.130.720.73 query7 0.020.010.02 query8 0.060.050.05 query9 0.540.490.49 query10 0.530.550.55 query11 0.170.120.12 query12 0.150.130.13 query13 0.630.600.59 query14 0.780.790.79 query15 0.870.830.82 query16 0.380.380.38 query17 1.060.961.00 query18 0.210.200.21 query19 1.821.841.77 query20 0.020.010.01 query21 15.39 0.660.66 query22 4.736.901.50 query23 18.28 1.401.17 query24 2.220.230.23 query25 0.140.080.09 query26 0.260.180.18 query27 0.080.080.09 query28 13.23 1.031.02 query29 12.62 3.313.29 query30 0.420.240.24 query31 2.800.400.40 query32 3.260.500.49 query33 2.972.963.02 query34 17.13 4.394.34 query35 4.434.434.44 query36 0.670.490.48 query37 0.210.180.17 query38 0.170.170.18 query39 0.060.050.06 query40 0.180.150.15 query41 0.120.080.07 query42 0.070.070.07 query43 0.060.060.06 Total cold run time: 110.39 s Total hot run time: 30.57 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](scan) fix predicate contains cast that results in null, the predicate will be miss. [doris]
yiguolei commented on code in PR #39550:
URL: https://github.com/apache/doris/pull/39550#discussion_r1721319147
##
regression-test/suites/correctness/test_scan_with_cast_null_value.groovy:
##
@@ -0,0 +1,38 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+suite("test_scan_with_cast_null_value") {
Review Comment:
然后这些测试，再跑一遍常量折叠打开的时候
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](statistics)Support enable/disable auto analyze for table. [doris]
doris-robot commented on PR #39532: URL: https://github.com/apache/doris/pull/39532#issuecomment-2295849767 TPC-DS: Total hot run time: 196112 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 684d4e02627d7ac2e3f1f0d6da726b80be3cd606, data reload: false query1 1330912 896 896 query2 6564202119331933 query3 10604 402437853785 query4 56658 23960 23391 23391 query5 5725715 722 715 query6 533 205 211 205 query7 6376327 329 327 query8 552 451 448 448 query9 8953252725142514 query10 571 344 336 336 query11 18620 15143 15315 15143 query12 207 141 142 141 query13 1746436 447 436 query14 11801 802874587458 query15 307 205 193 193 query16 7039511 513 511 query17 1179623 625 623 query18 1217348 369 348 query19 297 172 167 167 query20 142 133 138 133 query21 242 143 142 142 query22 4761432443374324 query23 34466 33697 33993 33697 query24 5786294130062941 query25 586 427 431 427 query26 742 186 186 186 query27 1911311 307 307 query28 3611216721332133 query29 676 437 452 437 query30 222 178 183 178 query31 1010853 810 810 query32 105 76 77 76 query33 541 344 345 344 query34 899 506 492 492 query35 871 795 771 771 query36 1090949 928 928 query37 151 109 104 104 query38 4060384738683847 query39 1508145414761454 query40 234 159 152 152 query41 139 139 142 139 query42 138 114 118 114 query43 538 510 529 510 query44 1122778 792 778 query45 224 191 199 191 query46 1126773 769 769 query47 1906182818111811 query48 455 342 342 342 query49 928 586 580 580 query50 864 474 455 455 query51 6962683467916791 query52 125 107 111 107 query53 301 226 225 225 query54 618 505 499 499 query55 89 91 89 89 query56 325 318 308 308 query57 1189114011181118 query58 298 302 287 287 query59 3003281027192719 query60 351 324 323 323 query61 153 150 147 147 query62 791 701 694 694 query63 257 250 231 231 query64 3137188319001883 query65 3265319531703170 query66 1033677 668 668 query67 15322 14904 14850 14850 query68 5674595 588 588 query69 618 348 314 314 query70 1222111711541117 query71 541 318 313 313 query72 7500235921522152 query73 797 355 353 353 query74 9278876188218761 query75 3841278927232723 query76 3524108810091009 query77 654 437 440 437 query78 9806910591289105 query79 2838550 545 545 query80 1998600 604 600 query81 589 259 260 259 query82 756 159 157 157 query83 340 216 211 211 query84 290 105 97 97 query85 1202365 360 360 query86 475 330 316 316 query87 4417425141624162 query88 4865247724902477 query89 453 326 322 322 query90 2001227 229 227 query91 157 128 127 127 query92 88 74 73 73 query93 5276554 550 550 query94 938 336 333 333 query95 394 302 307 302 query96 631 291 286 286 query97 3285306730573057 query98 249 233 231 231 query99 1589130612971297 Total cold run time: 324838 ms Total hot run time: 196112 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to
Re: [PR] [fix](scan) fix predicate contains cast that results in null, the predicate will be miss. [doris]
doris-robot commented on PR #39550: URL: https://github.com/apache/doris/pull/39550#issuecomment-2295851835 TPC-DS: Total hot run time: 196232 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit a018d0d595b2614b08324360ad4649ce68a9f573, data reload: false query1 1346905 883 883 query2 6626196019311931 query3 10777 396537443744 query4 55329 24934 23314 23314 query5 6194718 736 718 query6 554 214 219 214 query7 6461331 320 320 query8 547 438 448 438 query9 9404252225132513 query10 592 340 332 332 query11 18749 15205 15435 15205 query12 207 150 142 142 query13 1699424 422 422 query14 12136 717372937173 query15 250 203 202 202 query16 7734535 530 530 query17 1214605 620 605 query18 2134344 345 344 query19 285 172 176 172 query20 157 137 136 136 query21 247 143 140 140 query22 4445454645854546 query23 34425 33801 34015 33801 query24 5698298129962981 query25 591 442 431 431 query26 708 183 180 180 query27 1844312 305 305 query28 3979217421222122 query29 717 431 441 431 query30 228 178 181 178 query31 986 846 814 814 query32 104 75 81 75 query33 568 344 369 344 query34 875 504 483 483 query35 861 788 770 770 query36 1075950 965 950 query37 157 104 100 100 query38 4036387138673867 query39 1507143614961436 query40 243 159 152 152 query41 142 142 136 136 query42 132 115 114 114 query43 525 492 500 492 query44 1101780 788 780 query45 222 203 193 193 query46 1152758 773 758 query47 1944185118901851 query48 417 346 328 328 query49 905 572 600 572 query50 858 458 468 458 query51 6859678367886783 query52 122 130 111 111 query53 295 222 222 222 query54 604 506 513 506 query55 93 92 84 84 query56 331 310 305 305 query57 1155113911021102 query58 295 325 324 324 query59 2911294827772777 query60 356 328 326 326 query61 151 146 148 146 query62 779 700 711 700 query63 253 224 230 224 query64 3347184318801843 query65 3235318931283128 query66 1113676 681 676 query67 15296 15022 14900 14900 query68 7538575 574 574 query69 669 434 353 353 query70 1285117211661166 query71 558 314 318 314 query72 6692232821502150 query73 1715356 355 355 query74 9350883888388838 query75 4182269627692696 query76 4195104810101010 query77 827 440 435 435 query78 10901 936491089108 query79 9851557 549 549 query80 1139598 602 598 query81 618 257 254 254 query82 570 162 161 161 query83 355 213 213 213 query84 289 98 96 96 query85 790 356 353 353 query86 368 328 326 326 query87 4466420543334205 query88 3958250024582458 query89 549 324 317 317 query90 2278225 223 223 query91 154 126 126 126 query92 88 73 77 73 query93 5524550 538 538 query94 1075308 313 308 query95 393 297 310 297 query96 623 284 280 280 query97 3249306230733062 query98 240 233 223 223 query99 1608132112901290 Total cold run time: 336379 ms Total hot run time: 196232 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to
Re: [PR] [function](cast)Make string casting to integers more like MySQL's behavior [doris]
github-actions[bot] commented on PR #38847: URL: https://github.com/apache/doris/pull/38847#issuecomment-2295852801 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Refactor](inverted index) refactor inverted index compound predicates evaluate logic [doris]
airborne12 commented on PR #38908: URL: https://github.com/apache/doris/pull/38908#issuecomment-2295854153 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refine](bits) refine bytes_mask_to_bits_mask code [doris]
zhangstar333 merged PR #38360: URL: https://github.com/apache/doris/pull/38360 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [refine](bits) refine bytes_mask_to_bits_mask code (#38360)
This is an automated email from the ASF dual-hosted git repository.
zhangstar333 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 6ea6c2fb238 [refine](bits) refine bytes_mask_to_bits_mask code (#38360)
6ea6c2fb238 is described below
commit 6ea6c2fb2381b422caf157db3c617045aecf7be1
Author: Mryange <59914473+mrya...@users.noreply.github.com>
AuthorDate: Mon Aug 19 15:28:39 2024 +0800
[refine](bits) refine bytes_mask_to_bits_mask code (#38360)
## Proposed changes
The previous code only considered the x86 architecture, and
_mm_movemask_epi8 does not have a corresponding instruction in ARM.
According to the article below, we need to abstract the overall logic.
For ARM, optimize using the content mentioned in the following article:
filter function origin 0.711375 seconds 0.7154 seconds 0.71782 seconds
0.715296 seconds
filter function arm opt 0.559854 seconds 0.559854 seconds 0.559854
seconds 0.559854 seconds
[link](https://community.arm.com/arm-community-blogs/b/infrastructure-solutions-blog/posts/porting-x86-vector-bitmask-optimizations-to-arm-neon?CommentId=af187ac6-ae00-4e4d-bbf0-e142187aa92e)
---
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 30
be/src/util/simd/bits.h| 80 --
be/src/vec/columns/column_decimal.cpp | 37 +-
be/src/vec/columns/column_vector.cpp | 38 +-
be/src/vec/columns/columns_common.cpp | 37 +-
5 files changed, 144 insertions(+), 78 deletions(-)
diff --git a/be/src/olap/rowset/segment_v2/segment_iterator.cpp
b/be/src/olap/rowset/segment_v2/segment_iterator.cpp
index 2cec6f48f6b..8fa1a81540a 100644
--- a/be/src/olap/rowset/segment_v2/segment_iterator.cpp
+++ b/be/src/olap/rowset/segment_v2/segment_iterator.cpp
@@ -2223,23 +2223,21 @@ uint16_t
SegmentIterator::_evaluate_vectorization_predicate(uint16_t* sel_rowid_
uint32_t sel_pos = 0;
const uint32_t sel_end = sel_pos + selected_size;
-static constexpr size_t SIMD_BYTES = 32;
+static constexpr size_t SIMD_BYTES = simd::bits_mask_length();
const uint32_t sel_end_simd = sel_pos + selected_size / SIMD_BYTES *
SIMD_BYTES;
while (sel_pos < sel_end_simd) {
-auto mask = simd::bytes32_mask_to_bits32_mask(_ret_flags.data() +
sel_pos);
+auto mask = simd::bytes_mask_to_bits_mask(_ret_flags.data() + sel_pos);
if (0 == mask) {
//pass
-} else if (0x == mask) {
+} else if (simd::bits_mask_all() == mask) {
for (uint32_t i = 0; i < SIMD_BYTES; i++) {
sel_rowid_idx[new_size++] = sel_pos + i;
}
} else {
-while (mask) {
-const size_t bit_pos = __builtin_ctzll(mask);
-sel_rowid_idx[new_size++] = sel_pos + bit_pos;
-mask = mask & (mask - 1);
-}
+simd::iterate_through_bits_mask(
+[&](const size_t bit_pos) { sel_rowid_idx[new_size++] =
sel_pos + bit_pos; },
+mask);
}
sel_pos += SIMD_BYTES;
}
@@ -2709,23 +2707,23 @@ uint16_t
SegmentIterator::_evaluate_common_expr_filter(uint16_t* sel_rowid_idx,
uint16_t new_size = 0;
uint32_t sel_pos = 0;
const uint32_t sel_end = selected_size;
-static constexpr size_t SIMD_BYTES = 32;
+static constexpr size_t SIMD_BYTES = simd::bits_mask_length();
const uint32_t sel_end_simd = sel_pos + selected_size / SIMD_BYTES *
SIMD_BYTES;
while (sel_pos < sel_end_simd) {
-auto mask = simd::bytes32_mask_to_bits32_mask(filt_pos + sel_pos);
+auto mask = simd::bytes_mask_to_bits_mask(filt_pos + sel_pos);
if (0 == mask) {
//pass
-} else if (0x == mask) {
+} else if (simd::bits_mask_all() == mask) {
for (uint32_t i = 0; i < SIMD_BYTES; i++) {
sel_rowid_idx[new_size++] = sel_rowid_idx[sel_pos + i];
}
} else {
-while (mask) {
-const size_t bit_pos = __builtin_ctzll(mask);
-sel_rowid_idx[new_size++] = sel_rowid_idx[sel_pos +
bit_pos];
-mask = mask & (mask - 1);
-}
+simd::iterate_through_bits_mask(
+[&](const size_t bit_pos) {
+sel_rowid_idx[new_size++] = sel_rowid_idx[sel_pos
+ bit_pos];
+},
+mask);
}
sel_pos += SIMD_BYTES;
}
diff --git a/be/src/util/simd/bits.h b/be/src/util/simd/bits.h
index a36a95b6eef..7e2e7c82025 100644
--- a/be/src/util/simd/bits.h
+++ b/be/src/util/simd/bits.h
@@ -
Re: [PR] [ci](fix) adjust GITHUB_TOKEN permissions [doris]
github-actions[bot] commented on PR #39553: URL: https://github.com/apache/doris/pull/39553#issuecomment-2295855756 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [ci](fix) adjust GITHUB_TOKEN permissions [doris]
github-actions[bot] commented on PR #39553: URL: https://github.com/apache/doris/pull/39553#issuecomment-2295855830 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (6ea6c2fb238 -> 4a669f725ff)
This is an automated email from the ASF dual-hosted git repository. hellostephen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 6ea6c2fb238 [refine](bits) refine bytes_mask_to_bits_mask code (#38360) add 4a669f725ff [ci](fix) adjust GITHUB_TOKEN permissions (#39553) No new revisions were added by this update. Summary of changes: .github/workflows/comment-to-trigger-teamcity.yml | 5 + 1 file changed, 5 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [ci](fix) adjust GITHUB_TOKEN permissions [doris]
hello-stephen merged PR #39553: URL: https://github.com/apache/doris/pull/39553 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](statistics)Support enable/disable auto analyze for table. [doris]
doris-robot commented on PR #39532: URL: https://github.com/apache/doris/pull/39532#issuecomment-2295858762 ClickBench: Total hot run time: 31.04 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 684d4e02627d7ac2e3f1f0d6da726b80be3cd606, data reload: false query1 0.050.040.04 query2 0.080.040.04 query3 0.230.060.06 query4 1.660.090.09 query5 0.480.470.48 query6 1.120.730.73 query7 0.020.020.02 query8 0.060.050.05 query9 0.550.490.50 query10 0.550.550.52 query11 0.170.130.12 query12 0.150.130.13 query13 0.630.610.59 query14 0.790.780.80 query15 0.860.820.82 query16 0.380.380.38 query17 0.980.981.00 query18 0.220.200.21 query19 1.851.731.75 query20 0.010.010.01 query21 15.39 0.660.65 query22 4.747.051.86 query23 18.27 1.431.33 query24 2.140.250.23 query25 0.170.090.09 query26 0.270.180.19 query27 0.100.080.08 query28 13.20 1.031.01 query29 12.72 3.363.32 query30 0.440.250.25 query31 2.830.410.40 query32 3.240.490.48 query33 2.962.942.96 query34 17.04 4.344.32 query35 4.404.414.45 query36 0.660.500.51 query37 0.220.180.18 query38 0.180.160.17 query39 0.060.050.05 query40 0.190.150.15 query41 0.120.070.07 query42 0.070.070.07 query43 0.060.060.07 Total cold run time: 110.31 s Total hot run time: 31.04 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](compile) skip build Cloud on ARM platform [doris]
hello-stephen merged PR #39508: URL: https://github.com/apache/doris/pull/39508 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](compile) skip build Cloud on ARM platform (#39508)
This is an automated email from the ASF dual-hosted git repository.
hellostephen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new be80cf4b8b4 [fix](compile) skip build Cloud on ARM platform (#39508)
be80cf4b8b4 is described below
commit be80cf4b8b42d522ad2f1112a8c42dc804a9ed59
Author: Dongyang Li
AuthorDate: Mon Aug 19 15:31:17 2024 +0800
[fix](compile) skip build Cloud on ARM platform (#39508)
## Proposed changes
Issue Number: close #xxx
Co-authored-by: stephen
---
build.sh | 6 ++
1 file changed, 6 insertions(+)
diff --git a/build.sh b/build.sh
index e2a7f33bd52..2eca69a17a6 100755
--- a/build.sh
+++ b/build.sh
@@ -271,6 +271,12 @@ else
fi
fi
+ARCH="$(uname -m)"
+if [[ "${ARCH}" == "aarch64" ]]; then
+echo "WARNING: Cloud module is not supported on ARM platform, will skip
building it."
+BUILD_CLOUD=0
+fi
+
if [[ "${HELP}" -eq 1 ]]; then
usage
fi
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv)transfer col in mysql varchar(100) to text when create MTMV [doris]
zddr commented on PR #37668: URL: https://github.com/apache/doris/pull/37668#issuecomment-2295859858 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](scan) fix predicate contains cast that results in null, the predicate will be miss. [doris]
doris-robot commented on PR #39550: URL: https://github.com/apache/doris/pull/39550#issuecomment-2295860948 ClickBench: Total hot run time: 30.7 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit a018d0d595b2614b08324360ad4649ce68a9f573, data reload: false query1 0.040.040.04 query2 0.070.040.04 query3 0.230.060.05 query4 1.670.090.07 query5 0.480.490.52 query6 1.140.730.72 query7 0.020.010.01 query8 0.050.050.05 query9 0.550.480.48 query10 0.540.540.52 query11 0.170.130.12 query12 0.160.120.12 query13 0.620.600.59 query14 0.760.780.77 query15 0.860.810.83 query16 0.370.380.39 query17 0.951.001.00 query18 0.210.200.20 query19 1.831.691.68 query20 0.020.020.01 query21 15.43 0.660.67 query22 4.797.331.71 query23 18.24 1.431.24 query24 2.140.220.22 query25 0.160.090.08 query26 0.280.190.18 query27 0.080.080.09 query28 13.26 1.031.01 query29 13.02 3.373.35 query30 0.370.190.18 query31 2.810.400.40 query32 3.240.490.51 query33 2.952.982.94 query34 17.26 4.404.36 query35 4.424.474.43 query36 0.670.490.49 query37 0.220.190.17 query38 0.180.170.17 query39 0.070.050.05 query40 0.190.150.15 query41 0.120.070.08 query42 0.080.070.08 query43 0.060.060.05 Total cold run time: 110.78 s Total hot run time: 30.7 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [regression_test](flink) add await for commit phase [doris]
doris-robot commented on PR #39554: URL: https://github.com/apache/doris/pull/39554#issuecomment-2295862823 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](http-api) fix core dump on API check_rpc_channel coz exec_env not init [doris]
doris-robot commented on PR #39520: URL: https://github.com/apache/doris/pull/39520#issuecomment-2295862777 TPC-H: Total hot run time: 38219 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit be340f87b80bcd3d06b4844406b0ec5cd3f1b80a, data reload: false -- Round 1 -- q1 17847 441243454345 q2 2054209 216 209 q3 11761 101111691011 q4 10518 709 761 709 q5 7799284127982798 q6 271 163 163 163 q7 1039665 666 665 q8 9617211921052105 q9 8801656465916564 q10 7047224421922192 q11 501 265 270 265 q12 418 252 247 247 q13 17796 299929862986 q14 296 256 250 250 q15 558 520 539 520 q16 515 404 404 404 q17 984 699 744 699 q18 7395673068406730 q19 7850105910991059 q20 706 352 347 347 q21 4399315829172917 q22 1155105510341034 Total cold run time: 119327 ms Total hot run time: 38219 ms - Round 2, with runtime_filter_mode=off - q1 4610437043124312 q2 392 295 311 295 q3 2859270027242700 q4 2041171417001700 q5 5597576656355635 q6 240 162 154 154 q7 2150176418061764 q8 3358352034683468 q9 8794874887948748 q10 3604331232513251 q11 632 540 558 540 q12 853 678 631 631 q13 15894 322530313031 q14 325 292 290 290 q15 563 527 525 525 q16 531 464 465 464 q17 1848157315581558 q18 8223783478227822 q19 7280174216311631 q20 2218190218881888 q21 14245 539253835383 q22 1187108910991089 Total cold run time: 87444 ms Total hot run time: 56879 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [regression_test](flink) add await for commit phase [doris]
JNSimba opened a new pull request, #39554: URL: https://github.com/apache/doris/pull/39554 ## Proposed changes Issue Number: close #xxx The publish in the commit phase of streamload is asynchronous, so the data may not be visible. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Refactor](inverted index) refactor inverted index compound predicates evaluate logic [doris]
hello-stephen commented on PR #38908: URL: https://github.com/apache/doris/pull/38908#issuecomment-2295864390 run feut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](Load)only check partitions' state in loading process, instead of checking table state [doris]
doris-robot commented on PR #39411: URL: https://github.com/apache/doris/pull/39411#issuecomment-2295867289 TPC-H: Total hot run time: 50686 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 208203b98daf8609c8b89473755dc9b1939aa3fc, data reload: false -- Round 1 -- q1 18232 448244914482 q2 2071195 191 191 q3 10181 191219171912 q4 10350 127413421274 q5 8545394039303930 q6 274 143 141 141 q7 2044166616561656 q8 9336278627762776 q9 10507 10405 10379 10379 q10 8700355235143514 q11 462 280 276 276 q12 498 339 351 339 q13 19208 398340563983 q14 370 350 349 349 q15 553 502 506 502 q16 709 605 612 605 q17 1156996 999 996 q18 7310685669546856 q19 1761163415781578 q20 578 342 332 332 q21 4529422741704170 q22 557 445 465 445 Total cold run time: 117931 ms Total hot run time: 50686 ms - Round 2, with runtime_filter_mode=off - q1 4530456845044504 q2 377 295 296 295 q3 4297430842834283 q4 2871285228672852 q5 7490720672317206 q6 261 147 144 144 q7 3304288129252881 q8 4382454245284528 q9 16994 16839 16676 16676 q10 4250433143154315 q11 800 718 690 690 q12 1055871 874 871 q13 7398379137463746 q14 479 438 438 438 q15 544 500 512 500 q16 773 714 714 714 q17 3843386738763867 q18 8827871088018710 q19 1756174717231723 q20 2404215521462146 q21 8531846684458445 q22 1071976 948 948 Total cold run time: 86237 ms Total hot run time: 80482 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv)use name instead of id in meta of MTMV [doris]
github-actions[bot] commented on PR #39355: URL: https://github.com/apache/doris/pull/39355#issuecomment-2295868283 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](diagnose) add tablet in recycle bin hint [doris]
doris-robot commented on PR #39547: URL: https://github.com/apache/doris/pull/39547#issuecomment-2295875679 TPC-H: Total hot run time: 38434 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit b1b12cc63cd7b85d561ff760c89e18c2f8c44b67, data reload: false -- Round 1 -- q1 17850 440742834283 q2 2040220 220 220 q3 11728 1150 q4 10524 747 716 716 q5 7780284028032803 q6 265 160 159 159 q7 1026653 655 653 q8 9580208721162087 q9 8804653665716536 q10 7117226022862260 q11 467 275 273 273 q12 431 258 257 257 q13 18830 297130172971 q14 306 257 261 257 q15 563 535 534 534 q16 534 429 421 421 q17 989 727 673 673 q18 7317688567236723 q19 6858109311071093 q20 696 353 363 353 q21 4103320130193019 q22 1129104410321032 Total cold run time: 118937 ms Total hot run time: 38434 ms - Round 2, with runtime_filter_mode=off - q1 4530433743094309 q2 417 303 316 303 q3 2878270027752700 q4 2029171717571717 q5 5618580756015601 q6 237 150 143 143 q7 2232176817881768 q8 3422348734603460 q9 8709876387528752 q10 3588330833073307 q11 615 539 512 512 q12 830 695 673 673 q13 17115 303531483035 q14 324 312 298 298 q15 574 527 516 516 q16 515 447 469 447 q17 1838153615171517 q18 8389784376767676 q19 7461161316501613 q20 2159192018771877 q21 13940 528653065286 q22 1194107810481048 Total cold run time: 88614 ms Total hot run time: 56558 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](cloud) fix alter consume offset can not work in cloud mode [doris]
sollhui commented on PR #39159: URL: https://github.com/apache/doris/pull/39159#issuecomment-2295874255 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt]function use sse to opt match_ipv6_subnet [doris]
zhangstar333 merged PR #38755: URL: https://github.com/apache/doris/pull/38755 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [opt]function use sse to opt match_ipv6_subnet (#38755)
This is an automated email from the ASF dual-hosted git repository.
zhangstar333 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 37044e1a292 [opt]function use sse to opt match_ipv6_subnet (#38755)
37044e1a292 is described below
commit 37044e1a292563d20ec0dac57a8c7e1282e92278
Author: Mryange <59914473+mrya...@users.noreply.github.com>
AuthorDate: Mon Aug 19 15:41:22 2024 +0800
[opt]function use sse to opt match_ipv6_subnet (#38755)
## Proposed changes
test
```
---
Benchmark Time CPU Iterations
---
BM_matchIPv6SubnetSSE 1.89 ns 1.89 ns 10
BM_matchIPv6SubnetNative 4.99 ns 4.99 ns561455254
```
---
be/src/vec/runtime/ip_address_cidr.h | 26 +-
1 file changed, 25 insertions(+), 1 deletion(-)
diff --git a/be/src/vec/runtime/ip_address_cidr.h
b/be/src/vec/runtime/ip_address_cidr.h
index 789d93d40e0..de4c0050982 100644
--- a/be/src/vec/runtime/ip_address_cidr.h
+++ b/be/src/vec/runtime/ip_address_cidr.h
@@ -20,8 +20,8 @@
#pragma once
+#include "util/sse_util.hpp"
#include "vec/common/format_ip.h"
-
namespace doris {
class IPAddressVariant {
@@ -73,6 +73,29 @@ bool match_ipv4_subnet(uint32_t addr, uint32_t cidr_addr,
uint8_t prefix) {
return (addr & mask) == (cidr_addr & mask);
}
+#if defined(__SSE2__) || defined(__aarch64__)
+
+bool match_ipv6_subnet(const uint8_t* addr, const uint8_t* cidr_addr, uint8_t
prefix) {
+uint16_t mask = _mm_movemask_epi8(
+_mm_cmpeq_epi8(_mm_loadu_si128(reinterpret_cast(addr)),
+ _mm_loadu_si128(reinterpret_cast(cidr_addr;
+mask = ~mask;
+
+if (mask) {
+const auto offset = std::countl_zero(mask);
+if (prefix / 8 != offset) {
+return prefix / 8 < offset;
+}
+auto cmpmask = ~(0xff >> (prefix % 8));
+return (addr[IPV6_BINARY_LENGTH - 1 - offset] & cmpmask) ==
+ (cidr_addr[IPV6_BINARY_LENGTH - 1 - offset] & cmpmask);
+} else {
+// All the bytes are equal.
+}
+return true;
+}
+
+#else
// ipv6 liitle-endian input
bool match_ipv6_subnet(const uint8_t* addr, const uint8_t* cidr_addr, uint8_t
prefix) {
if (prefix > IPV6_BINARY_LENGTH * 8U) {
@@ -93,6 +116,7 @@ bool match_ipv6_subnet(const uint8_t* addr, const uint8_t*
cidr_addr, uint8_t pr
auto mask = ~(0xff >> prefix);
return (addr[i] & mask) == (cidr_addr[i] & mask);
}
+#endif
IPAddressCIDR parse_ip_with_cidr(std::string_view cidr_str) {
size_t pos_slash = cidr_str.find('/');
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](arm)Remove negative optimizations of SSE2NEON on memcmp for ARM [doris]
zhangstar333 merged PR #38759: URL: https://github.com/apache/doris/pull/38759 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [opt](arm)Remove negative optimizations of SSE2NEON on memcmp for ARM (#38759)
This is an automated email from the ASF dual-hosted git repository.
zhangstar333 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new b2c87f4f4d3 [opt](arm)Remove negative optimizations of SSE2NEON on
memcmp for ARM (#38759)
b2c87f4f4d3 is described below
commit b2c87f4f4d3ec2196db2e4957c0770effbd00d2b
Author: Mryange <59914473+mrya...@users.noreply.github.com>
AuthorDate: Mon Aug 19 15:41:37 2024 +0800
[opt](arm)Remove negative optimizations of SSE2NEON on memcmp for ARM
(#38759)
The main issue is that _mm_movemask_epi8 does not have a one-to-one
corresponding instruction on ARM. Testing shows that it performs worse
compared to using memcmp, which allows the compiler to generate the
corresponding ARM instructions.
The following tests were conducted on ARM.
```
--
BenchmarkTime CPU Iterations
--
BM_memequal16_sse 3.77 ns 3.77 ns743238946
BM_memequal16_orgin 2.11 ns 2.11 ns 10
```
---
be/src/vec/common/memcmp_small.h | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/be/src/vec/common/memcmp_small.h b/be/src/vec/common/memcmp_small.h
index 90a2ad183dc..194e8deedba 100644
--- a/be/src/vec/common/memcmp_small.h
+++ b/be/src/vec/common/memcmp_small.h
@@ -38,7 +38,7 @@ int cmp(T a, T b) {
/// Results don't depend on the values inside uninitialized memory but Memory
Sanitizer cannot see it.
/// Disable optimized functions if compile with Memory Sanitizer.
-#if (defined(__SSE2__) || defined(__aarch64__)) && !defined(MEMORY_SANITIZER)
+#if (defined(__SSE2__) && !defined(__aarch64__)) && !defined(MEMORY_SANITIZER)
#include "util/sse_util.hpp"
/** All functions works under the following assumptions:
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv)use name instead of id in meta of MTMV [doris]
doris-robot commented on PR #39355: URL: https://github.com/apache/doris/pull/39355#issuecomment-2295881183 TPC-H: Total hot run time: 37955 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit c5b317afdae2af2d37d5012d287cf853582799af, data reload: false -- Round 1 -- q1 17848 438743164316 q2 2057209 203 203 q3 11813 111611681116 q4 10525 751 772 751 q5 7800284828142814 q6 263 157 156 156 q7 1019660 636 636 q8 9590206121132061 q9 8716651265346512 q10 7060223922032203 q11 471 264 268 264 q12 426 253 256 253 q13 17791 300929992999 q14 312 255 256 255 q15 562 537 534 534 q16 539 405 409 405 q17 970 601 729 601 q18 7411677867446744 q19 6452108010281028 q20 701 333 339 333 q21 3875285227762776 q22 1131995 1020995 Total cold run time: 117332 ms Total hot run time: 37955 ms - Round 2, with runtime_filter_mode=off - q1 4560427843294278 q2 418 306 299 299 q3 2787266026162616 q4 1994173617571736 q5 5645571956565656 q6 233 149 160 149 q7 2168178117341734 q8 3274347134673467 q9 8772869287508692 q10 3590333733173317 q11 612 539 543 539 q12 837 672 665 665 q13 17207 315231613152 q14 320 300 290 290 q15 551 506 510 506 q16 494 443 456 443 q17 1815152715391527 q18 8502783676357635 q19 6855165615721572 q20 2193188118951881 q21 13719 518653645186 q22 1146109110551055 Total cold run time: 87692 ms Total hot run time: 56395 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [log](statistics)Add result row count log for statistics internal query. [doris]
doris-robot commented on PR #39556: URL: https://github.com/apache/doris/pull/39556#issuecomment-2295883528 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [log](statistics)Add result row count log for statistics internal query. [doris]
Jibing-Li commented on PR #39556: URL: https://github.com/apache/doris/pull/39556#issuecomment-2295884657 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](inverted index) Improved top-N optimization by refining the sorting column check. [doris]
zzzxl1993 commented on PR #39496: URL: https://github.com/apache/doris/pull/39496#issuecomment-2295882858 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [log](statistics)Add result row count log for statistics internal query. [doris]
Jibing-Li opened a new pull request, #39556: URL: https://github.com/apache/doris/pull/39556 Add result row count log for statistics internal query. Change some log level to debug to reduce log size. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](http-api) fix core dump on API check_rpc_channel coz exec_env not init [doris]
doris-robot commented on PR #39520: URL: https://github.com/apache/doris/pull/39520#issuecomment-2295885609 TPC-DS: Total hot run time: 195522 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit be340f87b80bcd3d06b4844406b0ec5cd3f1b80a, data reload: false query1 1334913 895 895 query2 6720196919371937 query3 10650 382738683827 query4 58219 24306 23245 23245 query5 6113721 715 715 query6 541 204 225 204 query7 6405326 326 326 query8 544 449 432 432 query9 9442252925242524 query10 596 341 330 330 query11 15747 15051 15384 15051 query12 230 129 130 129 query13 1669440 434 434 query14 12014 709866466646 query15 281 216 197 197 query16 7606534 500 500 query17 1196618 603 603 query18 2106371 401 371 query19 331 178 167 167 query20 144 135 134 134 query21 248 146 146 146 query22 4529425442114211 query23 34445 33701 34055 33701 query24 5715296630552966 query25 574 429 442 429 query26 715 184 183 183 query27 1754302 306 302 query28 4144219021782178 query29 737 461 457 457 query30 244 191 193 191 query31 1056817 815 815 query32 102 78 78 78 query33 511 346 344 344 query34 906 507 495 495 query35 871 767 768 767 query36 1093939 941 939 query37 161 104 107 104 query38 4011382038793820 query39 1560148614751475 query40 243 154 153 153 query41 142 136 136 136 query42 136 114 118 114 query43 545 511 498 498 query44 1128775 791 775 query45 228 201 196 196 query46 1132788 794 788 query47 1904185118521851 query48 421 347 338 338 query49 919 593 579 579 query50 863 460 479 460 query51 6760668968476689 query52 117 109 109 109 query53 309 228 221 221 query54 609 505 504 504 query55 91 91 90 90 query56 332 306 333 306 query57 1196113311231123 query58 295 297 301 297 query59 2995278127412741 query60 351 329 340 329 query61 148 144 145 144 query62 797 709 708 708 query63 258 226 229 226 query64 3362190018761876 query65 3205320131943194 query66 1034673 720 673 query67 15194 15056 15066 15056 query68 5964578 583 578 query69 586 313 324 313 query70 1203118311731173 query71 535 322 312 312 query72 7609231120992099 query73 806 355 355 355 query74 9496890588678867 query75 4441278327722772 query76 3341110210281028 query77 821 432 492 432 query78 10594 940891389138 query79 9286555 559 555 query80 1042601 605 601 query81 599 262 255 255 query82 799 159 156 156 query83 417 212 214 212 query84 296 97 95 95 query85 809 362 358 358 query86 420 297 307 297 query87 4424423342424233 query88 5144246624672466 query89 535 328 330 328 query90 2072229 230 229 query91 156 128 159 128 query92 83 75 76 75 query93 5727535 541 535 query94 772 314 319 314 query95 387 298 300 298 query96 635 287 287 287 query97 3252308130433043 query98 253 228 231 228 query99 1599132013411320 Total cold run time: 334081 ms Total hot run time: 195522 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to
Re: [PR] [Refactor](inverted index) refactor inverted index compound predicates evaluate logic [doris]
hello-stephen commented on PR #38908: URL: https://github.com/apache/doris/pull/38908#issuecomment-2295887255 run cloudut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](inverted index) Fix match_regexp to correctly handle empty string patterns [doris]
zzzxl1993 commented on PR #39503: URL: https://github.com/apache/doris/pull/39503#issuecomment-2295889187 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](Load)only check partitions' state in loading process, instead of checking table state [doris]
doris-robot commented on PR #39411: URL: https://github.com/apache/doris/pull/39411#issuecomment-2295891140 TPC-DS: Total hot run time: 209156 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 208203b98daf8609c8b89473755dc9b1939aa3fc, data reload: false query1 978 430 409 409 query2 6783225322382238 query3 6955227 226 226 query4 21165 18263 18101 18101 query5 19948 674267466742 query6 335 263 276 263 query7 4187333 337 333 query8 491 482 487 482 query9 3245281527432743 query10 481 369 358 358 query11 11507 10767 10785 10767 query12 154 117 108 108 query13 5676718 723 718 query14 18304 13385 14087 13385 query15 380 261 247 247 query16 6500338 312 312 query17 15821465934 934 query18 2338503 480 480 query19 242 193 190 190 query20 115 114 112 112 query21 242 148 161 148 query22 5365516248954895 query23 32734 32064 32034 32034 query24 7032654465996544 query25 578 476 479 476 query26 557 192 189 189 query27 1840328 332 328 query28 6070244423902390 query29 2978282027642764 query30 278 210 207 207 query31 1004820 841 820 query32 99 96 92 92 query33 486 338 335 335 query34 912 520 528 520 query35 1181978 1003978 query36 1378118913721189 query37 118 89 89 89 query38 3074292129792921 query39 1492142814461428 query40 258 144 145 144 query41 162 154 153 153 query42 110 107 112 107 query43 776 677 672 672 query44 1182788 787 787 query45 284 271 267 267 query46 1292989 1029989 query47 1957203517851785 query48 1053753 739 739 query49 842 580 585 580 query50 951 723 672 672 query51 4830490147404740 query52 112 99 109 99 query53 504 394 381 381 query54 2757255125392539 query55 109 112 97 97 query56 318 304 289 289 query57 1321126512861265 query58 317 308 314 308 query59 3664326635333266 query60 292 287 291 287 query61 158 161 156 156 query62 951 546 552 546 query63 546 400 407 400 query64 2734169715571557 query65 3662361136113611 query66 1255814 803 803 query67 16436 15463 15584 15463 query68 8616707 702 702 query69 641 428 401 401 query70 1530157214011401 query71 458 359 372 359 query72 6568354235643542 query73 783 364 368 364 query74 6440598159605960 query75 4918383338803833 query76 4951121512651215 query77 880 432 416 416 query78 12626 12041 11900 11900 query79 8984664 687 664 query80 1965550 557 550 query81 541 280 275 275 query82 1695126 128 126 query83 249 220 214 214 query84 286 98 101 98 query85 1226412 411 411 query86 383 332 330 330 query87 3247306331133063 query88 5430254425402540 query89 446 329 334 329 query90 1872258 254 254 query91 193 171 157 157 query92 90 84 83 83 query93 5140555 585 555 query94 838 257 252 252 query95 1151110110971097 query96 657 350 338 338 query97 6530636064176360 query98 218 211 207 207 query99 2937963 976 963 Total cold run time: 320106 ms Total hot run time: 209156 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above
[PR] [enhance](mtmv)Prohibit creating materialized views in external catalogs [doris]
zddr opened a new pull request, #39557: URL: https://github.com/apache/doris/pull/39557 Prohibit creating materialized views in external catalogs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](mtmv)Prohibit creating materialized views in external catalogs [doris]
doris-robot commented on PR #39557: URL: https://github.com/apache/doris/pull/39557#issuecomment-2295892875 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](arm) Optimize the BlockBloomFilter::bucket_find on ARM platforms using NEON instructions. [doris]
zhangstar333 merged PR #3: URL: https://github.com/apache/doris/pull/3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (b2c87f4f4d3 -> d3d35842ec7)
This is an automated email from the ASF dual-hosted git repository. zhangstar333 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from b2c87f4f4d3 [opt](arm)Remove negative optimizations of SSE2NEON on memcmp for ARM (#38759) add d3d35842ec7 [opt](arm) Optimize the BlockBloomFilter::bucket_find on ARM platforms using NEON instructions. (#3) No new revisions were added by this update. Summary of changes: be/src/exprs/block_bloom_filter.hpp | 36 - be/src/exprs/block_bloom_filter_impl.cc | 29 +++--- 2 files changed, 61 insertions(+), 4 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](http-api) fix core dump on API check_rpc_channel coz exec_env not init [doris]
doris-robot commented on PR #39520: URL: https://github.com/apache/doris/pull/39520#issuecomment-2295896556 ClickBench: Total hot run time: 31.51 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit be340f87b80bcd3d06b4844406b0ec5cd3f1b80a, data reload: false query1 0.050.040.04 query2 0.080.050.04 query3 0.230.060.05 query4 1.650.100.10 query5 0.510.510.50 query6 1.130.730.72 query7 0.020.010.01 query8 0.060.050.05 query9 0.550.490.48 query10 0.550.550.54 query11 0.170.130.13 query12 0.160.120.12 query13 0.620.590.59 query14 0.780.790.78 query15 0.860.850.84 query16 0.370.380.35 query17 1.071.021.02 query18 0.210.200.21 query19 1.851.751.76 query20 0.010.010.01 query21 15.39 0.660.65 query22 3.927.412.44 query23 18.26 1.431.25 query24 2.050.240.23 query25 0.160.080.08 query26 0.260.180.19 query27 0.090.080.08 query28 13.22 1.041.01 query29 12.66 3.323.28 query30 0.430.190.20 query31 2.790.410.39 query32 3.250.480.49 query33 2.933.022.98 query34 17.10 4.304.30 query35 4.434.414.41 query36 0.680.480.48 query37 0.210.170.18 query38 0.170.180.17 query39 0.070.060.06 query40 0.180.160.16 query41 0.110.070.07 query42 0.070.070.07 query43 0.070.060.07 Total cold run time: 109.43 s Total hot run time: 31.51 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](diagnose) add tablet in recycle bin hint [doris]
doris-robot commented on PR #39547: URL: https://github.com/apache/doris/pull/39547#issuecomment-229580 TPC-DS: Total hot run time: 196310 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit b1b12cc63cd7b85d561ff760c89e18c2f8c44b67, data reload: false query1 1331922 882 882 query2 6725195919751959 query3 10653 365738423657 query4 55356 24550 23290 23290 query5 5766658 650 650 query6 550 217 213 213 query7 6354329 335 329 query8 541 448 463 448 query9 9120255225182518 query10 590 346 337 337 query11 16989 15096 15192 15096 query12 199 145 143 143 query13 1700459 463 459 query14 11905 758273497349 query15 254 198 199 198 query16 7577560 506 506 query17 1192644 649 644 query18 1964359 350 350 query19 311 177 168 168 query20 160 143 136 136 query21 247 140 144 140 query22 4704458844814481 query23 34431 33870 34086 33870 query24 5703295630052956 query25 565 444 436 436 query26 709 181 181 181 query27 1930311 307 307 query28 3936216921632163 query29 711 452 447 447 query30 218 189 179 179 query31 1020840 771 771 query32 100 81 80 80 query33 514 355 340 340 query34 896 506 495 495 query35 865 754 782 754 query36 1115950 955 950 query37 155 100 101 100 query38 3932387938443844 query39 1535148114591459 query40 238 159 157 157 query41 139 138 140 138 query42 138 114 119 114 query43 529 489 503 489 query44 1134778 790 778 query45 225 193 191 191 query46 1122795 776 776 query47 1944189418961894 query48 409 339 327 327 query49 928 590 582 582 query50 878 462 458 458 query51 6896680767326732 query52 118 110 110 110 query53 297 226 223 223 query54 621 509 498 498 query55 90 90 88 88 query56 325 314 311 311 query57 1201115711521152 query58 295 296 306 296 query59 3067278228762782 query60 354 321 327 321 query61 154 148 151 148 query62 794 706 723 706 query63 262 224 223 223 query64 3159186018461846 query65 3233316332263163 query66 1021689 678 678 query67 15442 15022 15068 15022 query68 5793584 580 580 query69 581 319 321 319 query70 1222118311911183 query71 538 322 323 322 query72 7124229520902090 query73 815 355 353 353 query74 9179882287438743 query75 4141278727752775 query76 3561978 1107978 query77 688 450 450 450 query78 9884922489878987 query79 4675546 541 541 query80 2784607 615 607 query81 606 263 260 260 query82 893 157 156 156 query83 371 214 269 214 query84 298 98 100 98 query85 1322358 383 358 query86 475 327 308 308 query87 4362435742414241 query88 4964247124542454 query89 445 322 322 322 query90 1992232 226 226 query91 154 127 129 127 query92 89 74 75 74 query93 5347544 537 537 query94 869 323 332 323 query95 406 291 293 291 query96 617 278 280 278 query97 3253307930843079 query98 243 229 233 229 query99 1638131913241319 Total cold run time: 326865 ms Total hot run time: 196310 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to
Re: [PR] [improvement](mtmv) Only Generate rewritten plan when generate mv plan for performance [doris]
doris-robot commented on PR #39541: URL: https://github.com/apache/doris/pull/39541#issuecomment-2295900659 TPC-H: Total hot run time: 38028 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 1dda8d3659248eaadd0d2ce86da21484692e4fcf, data reload: false -- Round 1 -- q1 17847 433742924292 q2 2046215 205 205 q3 11901 972 1091972 q4 10523 801 848 801 q5 7775281628222816 q6 266 156 156 156 q7 1016644 650 644 q8 9583209920702070 q9 8769659565416541 q10 7082229222612261 q11 482 267 272 267 q12 430 258 254 254 q13 18082 301029832983 q14 303 254 256 254 q15 549 517 520 517 q16 535 419 405 405 q17 977 716 648 648 q18 7232680267336733 q19 6608112010271027 q20 694 351 345 345 q21 3801280628902806 q22 1132105310311031 Total cold run time: 117633 ms Total hot run time: 38028 ms - Round 2, with runtime_filter_mode=off - q1 4559431543024302 q2 395 300 304 300 q3 2840266926782669 q4 2024175717401740 q5 5665568356795679 q6 274 150 158 150 q7 2204181218151812 q8 3339355234593459 q9 8771876587438743 q10 3637336632673267 q11 630 538 525 525 q12 888 682 683 682 q13 16517 305430763054 q14 342 311 300 300 q15 567 523 527 523 q16 525 449 470 449 q17 1850155815601558 q18 8336779476947694 q19 7332166915131513 q20 2124192019061906 q21 14011 533253645332 q22 118310721072 Total cold run time: 88013 ms Total hot run time: 56729 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [log](statistics)Add result row count log for statistics internal query. [doris]
Jibing-Li commented on PR #39556: URL: https://github.com/apache/doris/pull/39556#issuecomment-2295901494 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](Load)only check partitions' state in loading process, instead of checking table state [doris]
doris-robot commented on PR #39411: URL: https://github.com/apache/doris/pull/39411#issuecomment-2295902335 ClickBench: Total hot run time: 31.21 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 208203b98daf8609c8b89473755dc9b1939aa3fc, data reload: false query1 0.030.020.03 query2 0.070.030.02 query3 0.250.050.05 query4 1.790.060.06 query5 0.540.520.53 query6 1.240.630.62 query7 0.020.010.02 query8 0.050.040.03 query9 0.530.490.49 query10 0.550.540.54 query11 0.130.100.09 query12 0.130.100.10 query13 0.630.620.63 query14 0.820.810.78 query15 0.780.770.76 query16 0.360.370.37 query17 1.040.991.02 query18 0.230.260.24 query19 1.831.871.86 query20 0.020.010.01 query21 15.45 0.550.55 query22 2.372.801.48 query23 16.74 1.020.88 query24 7.091.101.06 query25 0.380.080.07 query26 0.770.160.16 query27 0.050.050.05 query28 5.880.810.72 query29 12.80 2.382.37 query30 0.740.670.76 query31 2.830.400.39 query32 3.340.520.50 query33 3.093.073.07 query34 15.24 4.794.82 query35 4.884.864.85 query36 1.051.031.03 query37 0.080.060.06 query38 0.050.040.04 query39 0.030.040.03 query40 0.190.160.16 query41 0.080.040.03 query42 0.030.040.03 query43 0.040.040.04 Total cold run time: 104.24 s Total hot run time: 31.21 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](query) prefer to chose tablet on alive disk [doris]
yujun777 commented on PR #39467: URL: https://github.com/apache/doris/pull/39467#issuecomment-2295906063 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](Load)only check partitions' state in loading process, instead of checking table state [doris]
doris-robot commented on PR #39411: URL: https://github.com/apache/doris/pull/39411#issuecomment-2295908970 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 208203b98daf8609c8b89473755dc9b1939aa3fc with default session variables Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.3 seconds inserted 1000 Rows, about 469K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](diagnose) add tablet in recycle bin hint [doris]
doris-robot commented on PR #39547: URL: https://github.com/apache/doris/pull/39547#issuecomment-2295911727 ClickBench: Total hot run time: 30.77 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit b1b12cc63cd7b85d561ff760c89e18c2f8c44b67, data reload: false query1 0.040.040.04 query2 0.080.040.04 query3 0.220.050.05 query4 1.670.070.07 query5 0.490.490.48 query6 1.130.730.73 query7 0.020.020.01 query8 0.060.050.05 query9 0.540.480.49 query10 0.550.550.56 query11 0.160.120.12 query12 0.150.130.12 query13 0.620.590.59 query14 0.780.780.79 query15 0.860.830.82 query16 0.380.380.38 query17 1.061.061.00 query18 0.210.200.20 query19 1.821.751.70 query20 0.010.010.01 query21 15.39 0.670.66 query22 4.227.251.73 query23 18.37 1.431.29 query24 2.060.260.23 query25 0.150.090.09 query26 0.280.190.18 query27 0.080.080.08 query28 13.22 1.041.01 query29 12.62 3.353.29 query30 0.430.250.25 query31 2.820.410.40 query32 3.240.500.49 query33 2.983.022.95 query34 16.93 4.334.37 query35 4.424.394.40 query36 0.680.480.51 query37 0.210.180.17 query38 0.180.160.17 query39 0.060.060.05 query40 0.180.140.14 query41 0.120.070.07 query42 0.070.060.06 query43 0.060.050.06 Total cold run time: 109.62 s Total hot run time: 30.77 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](mtmv)Prohibit creating materialized views in external catalogs [doris]
feifeifeimoon commented on PR #39557: URL: https://github.com/apache/doris/pull/39557#issuecomment-2295915181 run beut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhance](mtmv)Prohibit creating materialized views in external catalogs [doris]
zddr commented on PR #39557: URL: https://github.com/apache/doris/pull/39557#issuecomment-2295921071 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [DNM](cloud-schema-change) Support shadow tablet to do cumulative compaction in cloud mode (#37293) [doris]
TangSiyang2001 opened a new pull request, #39558: URL: https://github.com/apache/doris/pull/39558 In cloud mode, when do schema change, shadow tablet encounters -235 because it cant do cumulative compaction in the case of a large number of loads. And it will prevents the user from continuing to loads. Implementation details: 1. When start schema change, record the end convert rowset version `alter_version` into SchemaChangeJob. 2. For origin tablet, only can do base compaction in [0, `alter_version`] and do cumulative compaction in (`alter_version`, N]. can not do compaction across `alter_verison` such as compaction [a, `alter_version` + n]. 3. For shadow tablet, cannot do base compaction and and do cumulative compaction in (`alter_version`, N]. 4. When the schema change failed because FE or BE coredump, it will retry. When retry the schema change, it will get the `alter_version` from meta_serive, and continue to do it. 5. When finish the schema change job or cancel it, we need to clear the schema change job. Before this pr, it will cover by next schema change. ## Proposed changes Issue Number: close #xxx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [DNM](cloud-schema-change) Support shadow tablet to do cumulative compaction in cloud mode (#37293) [doris]
doris-robot commented on PR #39558: URL: https://github.com/apache/doris/pull/39558#issuecomment-2295923933 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [DNM](cloud-schema-change) Support shadow tablet to do cumulative compaction in cloud mode (#37293) [doris]
TangSiyang2001 commented on PR #39558: URL: https://github.com/apache/doris/pull/39558#issuecomment-2295924542 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](predicate) fix wrong result of AcceptNullPredicate [doris]
yiguolei commented on code in PR #39497:
URL: https://github.com/apache/doris/pull/39497#discussion_r1721370343
##
be/src/olap/accept_null_predicate.h:
##
@@ -158,21 +156,26 @@ class AcceptNullPredicate : public ColumnPredicate {
}
// create selected_flags
uint16_t max_idx = sel[size - 1];
+std::vector old_sel(size);
+memcpy(old_sel.data(), sel, sizeof(uint16_t) * size);
const auto& nullable_col = assert_cast(column);
// call nested predicate evaluate
uint16_t new_size =
_nested->evaluate(nullable_col.get_nested_column(), sel, size);
Review Comment:
sel 1,2,3,7,8,9
sel 1,2,3,4,5,6,7,8,9
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [DNM](cloud-schema-change) Support shadow tablet to do cumulative compaction in cloud mode (#37293) [doris]
TangSiyang2001 commented on PR #39558: URL: https://github.com/apache/doris/pull/39558#issuecomment-2295927909 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](mtmv) Only Generate rewritten plan when generate mv plan for performance [doris]
doris-robot commented on PR #39541: URL: https://github.com/apache/doris/pull/39541#issuecomment-2295929223 TPC-DS: Total hot run time: 196921 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 1dda8d3659248eaadd0d2ce86da21484692e4fcf, data reload: false query1 1320901 884 884 query2 6636196319251925 query3 10749 390540023905 query4 58721 25703 23231 23231 query5 6236647 674 647 query6 586 210 207 207 query7 6423335 338 335 query8 549 447 450 447 query9 9183254325172517 query10 605 341 330 330 query11 18524 15052 15544 15052 query12 202 162 139 139 query13 1688498 439 439 query14 12509 731373797313 query15 340 195 193 193 query16 7452545 520 520 query17 1475644 637 637 query18 2088354 354 354 query19 311 169 171 169 query20 153 138 137 137 query21 261 143 144 143 query22 4723469146414641 query23 34906 34214 33555 33555 query24 5717298930032989 query25 574 459 441 441 query26 721 186 183 183 query27 1893311 304 304 query28 3849217521632163 query29 671 435 434 434 query30 255 183 187 183 query31 1012837 806 806 query32 122 78 79 78 query33 549 336 337 336 query34 899 505 493 493 query35 873 791 770 770 query36 1088956 958 956 query37 154 100 100 100 query38 3951388538333833 query39 1525146214631462 query40 243 157 154 154 query41 140 165 137 137 query42 135 114 116 114 query43 545 506 505 505 query44 1128789 788 788 query45 228 194 195 194 query46 1122800 758 758 query47 1993189718741874 query48 424 347 345 345 query49 926 568 583 568 query50 864 468 460 460 query51 6803668567716685 query52 128 107 106 106 query53 298 229 226 226 query54 613 501 500 500 query55 89 85 89 85 query56 325 300 304 300 query57 1232113011301130 query58 300 293 315 293 query59 3035273027732730 query60 353 328 329 328 query61 150 143 143 143 query62 804 699 699 699 query63 254 228 223 223 query64 4312234018511851 query65 3232322032053205 query66 1062670 671 670 query67 15395 15214 15049 15049 query68 8445584 633 584 query69 727 409 340 340 query70 1554117311681168 query71 632 319 314 314 query72 6945231620922092 query73 2709361 358 358 query74 9435892587988798 query75 5392270527942705 query76 5021109010341034 query77 811 448 444 444 query78 10229 10300 95329532 query79 9763566 563 563 query80 1404611 606 606 query81 617 260 262 260 query82 324 155 154 154 query83 341 213 216 213 query84 302 94 100 94 query85 804 357 356 356 query86 371 332 312 312 query87 4405414143094141 query88 4388249724872487 query89 430 328 325 325 query90 2447227 230 227 query91 156 125 126 125 query92 84 75 76 75 query93 2828562 562 562 query94 1323343 333 333 query95 404 302 345 302 query96 631 293 288 288 query97 3365319832023198 query98 250 236 229 229 query99 1648133113311331 Total cold run time: 343811 ms Total hot run time: 196921 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to
Re: [PR] [feature](nereids) Support SELECT * REPLACE clause [doris]
yiguolei merged PR #38680: URL: https://github.com/apache/doris/pull/38680 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Enhancement] supprt SELECT * REPLACE [doris]
yiguolei closed issue #36777: [Enhancement] supprt SELECT * REPLACE URL: https://github.com/apache/doris/issues/36777 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Enhancement] supprt SELECT * REPLACE [doris]
yiguolei closed issue #36777: [Enhancement] supprt SELECT * REPLACE URL: https://github.com/apache/doris/issues/36777 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (d3d35842ec7 -> 95b91c3c5bf)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from d3d35842ec7 [opt](arm) Optimize the BlockBloomFilter::bucket_find on
ARM platforms using NEON instructions. (#3)
add 95b91c3c5bf [feature](nereids) Support SELECT * REPLACE clause (#38680)
No new revisions were added by this update.
Summary of changes:
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 6 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 86 --
.../parser/LogicalPlanBuilderForCreateView.java| 6 +-
.../nereids/rules/analysis/BindExpression.java | 42 -
.../trees/plans/logical/LogicalProject.java| 42 +++--
.../trees/expressions/SelectExceptTest.java| 1 +
.../trees/expressions/SelectReplaceTest.java | 178 +
.../nereids/trees/plans/PlanToStringTest.java | 3 +-
.../data/nereids_syntax_p0/select_replace.out | 16 ++
.../select_replace.groovy} | 9 +-
10 files changed, 347 insertions(+), 42 deletions(-)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/SelectReplaceTest.java
create mode 100644 regression-test/data/nereids_syntax_p0/select_replace.out
copy
regression-test/suites/{nereids_p0/sql_functions/digital-masking/test_digital_masking.groovy
=> nereids_syntax_p0/select_replace.groovy} (74%)
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](move-memtable) add more injection test for load stream [doris]
kaijchen commented on PR #39383: URL: https://github.com/apache/doris/pull/39383#issuecomment-2295933375 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[I] [Feature] 希望提供分位数AGG_STATE的from_base64函数 [doris]
lukoou3 opened a new issue, #39559: URL: https://github.com/apache/doris/issues/39559 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Description hll类型可以通过hll_from_base64函数导入，除了hll类型，分位数聚合类型也比较常用，希望提供相关函数。 ### Use case 打算把数据从druid和clickhouse迁移到doris，聚合表使用到hll类型和分位数聚合类型，hll类型可以通过hll_from_base64函数导入，分位数聚合类型没有直接导入的方法。 ### Related issues _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](mtmv) Only Generate rewritten plan when generate mv plan for performance [doris]
doris-robot commented on PR #39541: URL: https://github.com/apache/doris/pull/39541#issuecomment-2295940775 ClickBench: Total hot run time: 31.74 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 1dda8d3659248eaadd0d2ce86da21484692e4fcf, data reload: false query1 0.050.040.04 query2 0.080.040.04 query3 0.230.050.05 query4 1.670.080.08 query5 0.510.490.51 query6 1.130.730.74 query7 0.020.010.01 query8 0.060.050.04 query9 0.530.480.49 query10 0.550.530.55 query11 0.150.130.12 query12 0.150.130.14 query13 0.620.590.58 query14 0.770.780.78 query15 0.860.830.82 query16 0.390.360.39 query17 0.970.991.05 query18 0.210.200.20 query19 1.891.741.73 query20 0.020.010.01 query21 15.39 0.680.66 query22 4.207.112.70 query23 18.26 1.341.25 query24 2.110.230.22 query25 0.170.080.09 query26 0.270.180.17 query27 0.080.080.08 query28 13.32 1.021.01 query29 12.63 3.303.30 query30 0.370.190.21 query31 2.800.410.41 query32 3.240.490.49 query33 2.963.002.92 query34 17.06 4.394.39 query35 4.444.444.45 query36 0.670.490.50 query37 0.220.180.17 query38 0.180.170.17 query39 0.060.050.06 query40 0.180.150.15 query41 0.110.070.07 query42 0.080.070.06 query43 0.060.060.07 Total cold run time: 109.72 s Total hot run time: 31.74 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](move-memtable) add more injection test for load stream [doris]
kaijchen commented on PR #39383: URL: https://github.com/apache/doris/pull/39383#issuecomment-2295941831 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [log](s3) return detailed error message to the user [doris]
kaijchen commented on PR #39551: URL: https://github.com/apache/doris/pull/39551#issuecomment-2295942911 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](sync mv) fix rewrite wrongly with sync mv in join [doris]
justfortaste commented on PR #39284: URL: https://github.com/apache/doris/pull/39284#issuecomment-2295953057 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](mtmv)transfer col in mysql varchar(100) to text when create MTMV [doris]
doris-robot commented on PR #37668: URL: https://github.com/apache/doris/pull/37668#issuecomment-2295954954 TPC-H: Total hot run time: 38145 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 1298f2c6808f723bb5ce43b45751236febcc2b6e, data reload: false -- Round 1 -- q1 18389 466143354335 q2 2052212 215 212 q3 10464 112311521123 q4 10209 810 825 810 q5 7781289228322832 q6 265 157 158 157 q7 1006684 646 646 q8 9397212920862086 q9 7212661465816581 q10 7090219021962190 q11 490 274 279 274 q12 438 261 256 256 q13 17907 303229842984 q14 309 259 260 259 q15 573 548 527 527 q16 529 418 419 418 q17 1017615 641 615 q18 7630691468366836 q19 6078110210141014 q20 708 363 350 350 q21 3829283926212621 q22 1128101910351019 Total cold run time: 114501 ms Total hot run time: 38145 ms - Round 2, with runtime_filter_mode=off - q1 4685430943484309 q2 429 324 313 313 q3 2895263026332630 q4 1932172016841684 q5 5700573456835683 q6 238 145 146 145 q7 2185178317471747 q8 3269343934253425 q9 8832852686828526 q10 3533332333093309 q11 616 524 525 524 q12 808 655 652 652 q13 17555 320331553155 q14 328 301 301 301 q15 562 534 548 534 q16 508 461 454 454 q17 1819155015341534 q18 8223790878177817 q19 3864166015801580 q20 3525183018271827 q21 14564 522153255221 q22 1194106210741062 Total cold run time: 87264 ms Total hot run time: 56432 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](profile)Enable merging of incomplete profiles. [doris]
doris-robot commented on PR #39560: URL: https://github.com/apache/doris/pull/39560#issuecomment-2295955867 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](file-cache) support system table file_cache_statistics [doris]
morningman commented on PR #39552: URL: https://github.com/apache/doris/pull/39552#issuecomment-2295955651 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [feature](profile)Enable merging of incomplete profiles. [doris]
Mryange opened a new pull request, #39560: URL: https://github.com/apache/doris/pull/39560 ## Proposed changes ``` java.lang.IndexOutOfBoundsException: Index 0 out of bounds for length 0 at jdk.internal.util.Preconditions.outOfBounds(Preconditions.java:64) ~[?:?] at jdk.internal.util.Preconditions.outOfBoundsCheckIndex(Preconditions.java:70) ~[?:?] at jdk.internal.util.Preconditions.checkIndex(Preconditions.java:266) ~[?:?] at java.util.Objects.checkIndex(Objects.java:359) ~[?:?] at java.util.ArrayList.get(ArrayList.java:427) ~[?:?] at org.apache.doris.common.profile.ExecutionProfile.getPipelineAggregatedProfile(ExecutionProfile.java:142) ~[doris-fe.jar:1.2-SNAPSHOT] ``` In the past, we needed to ensure that profiles were complete before merging. Now, this allows incomplete profiles to be merged, with missing profiles being marked in the merged profile. ``` - ProjectionTime: avg 0ns, max 0ns, min 0ns - RowsProduced: sum 0, avg 0, max 0, min 0 - WaitForDependency[SORT_OPERATOR_DEPENDENCY]Time: avg 15min2sec, max 15min2sec, min 15min2sec Pipeline : 3(miss profile): Pipeline : 4(instance_num=48): LOCAL_EXCHANGE_SINK_OPERATOR (PASSTHROUGH) (id=-14): - CloseTime: avg 0ns, max 0ns, min 0ns - ExecTime: avg 29.410us, max 43.336us, min ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](profile)Enable merging of incomplete profiles. [doris]
Mryange commented on PR #39560: URL: https://github.com/apache/doris/pull/39560#issuecomment-2295956498 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](file-cache) support system table file_cache_statistics [doris]
morningman commented on PR #39552: URL: https://github.com/apache/doris/pull/39552#issuecomment-2295957092 The test will be added after file cache is enabled in CI pipeline -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Refactor](inverted index) refactor inverted index compound predicates evaluate logic [doris]
doris-robot commented on PR #38908: URL: https://github.com/apache/doris/pull/38908#issuecomment-2295957903 TPC-H: Total hot run time: 38526 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 3e6e1cbe8fbc97b5707e0ca456aef01f3dc83f93, data reload: false -- Round 1 -- q1 17846 445443984398 q2 2048219 227 219 q3 11651 960 1221960 q4 10530 706 812 706 q5 7781290128412841 q6 265 161 165 161 q7 1043678 652 652 q8 9616211121512111 q9 8770657066026570 q10 7065226221992199 q11 512 283 276 276 q12 425 259 264 259 q13 17779 308830653065 q14 298 259 253 253 q15 580 535 535 535 q16 525 430 425 425 q17 1000718 679 679 q18 7452685666826682 q19 7529120111241124 q20 724 368 357 357 q21 4069301530523015 q22 1123104610391039 Total cold run time: 118631 ms Total hot run time: 38526 ms - Round 2, with runtime_filter_mode=off - q1 4549433443204320 q2 416 305 321 305 q3 2870268827122688 q4 2070173317601733 q5 5644578856575657 q6 242 158 149 149 q7 2185173517601735 q8 3372353634723472 q9 8812873988328739 q10 3634334032663266 q11 629 523 533 523 q12 828 662 668 662 q13 17353 308532263085 q14 327 313 306 306 q15 564 516 542 516 q16 520 464 462 462 q17 1845154315221522 q18 8308797576837683 q19 9401166116771661 q20 2152191319051905 q21 14107 537452555255 q22 1158106710351035 Total cold run time: 90986 ms Total hot run time: 56679 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
