(doris-website) branch asf-site updated (9a9b7ba4812 -> e835f725823)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 9a9b7ba4812 Automated deployment with doris branch @ 7032d0abc4ea24e483965036acc9753755adf12c new e835f725823 Automated deployment with doris branch @ 7032d0abc4ea24e483965036acc9753755adf12c This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (9a9b7ba4812) \ N -- N -- N refs/heads/asf-site (e835f725823) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (a8926fb9055 -> ec725b5f2e1)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard a8926fb9055 Automated deployment with doris branch @ 7032d0abc4ea24e483965036acc9753755adf12c new ec725b5f2e1 Automated deployment with doris branch @ 7032d0abc4ea24e483965036acc9753755adf12c This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (a8926fb9055) \ N -- N -- N refs/heads/asf-site (ec725b5f2e1) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] fix sparse caculate wrong paths and iterator init with wrong column_id [doris]
eldenmoon opened a new pull request, #48656: URL: https://github.com/apache/doris/pull/48656 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] fix sparse caculate wrong paths and iterator init with wrong column_id [doris]
hello-stephen commented on PR #48656: URL: https://github.com/apache/doris/pull/48656#issuecomment-2698700321 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement] (nereids)implement installPluginCommand in nereids [doris]
doris-robot commented on PR #48589: URL: https://github.com/apache/doris/pull/48589#issuecomment-2698427224 ClickBench: Total hot run time: 31.07 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 8d9429959c196ab2dc90f9e9591ba78f6e8cd207, data reload: false query1 0.040.030.03 query2 0.070.030.03 query3 0.250.060.06 query4 1.630.100.11 query5 0.570.550.56 query6 1.180.710.72 query7 0.030.020.01 query8 0.040.030.03 query9 0.580.520.53 query10 0.570.580.56 query11 0.160.100.11 query12 0.150.110.12 query13 0.610.590.60 query14 2.842.702.70 query15 0.930.850.86 query16 0.390.360.39 query17 1.040.991.03 query18 0.220.200.20 query19 1.911.812.02 query20 0.010.010.01 query21 15.37 0.900.55 query22 0.771.180.66 query23 14.95 1.360.62 query24 7.022.081.08 query25 0.510.280.15 query26 0.520.160.13 query27 0.050.050.04 query28 10.67 0.820.43 query29 12.57 4.013.36 query30 0.250.090.07 query31 2.840.610.39 query32 3.230.550.45 query33 3.023.023.11 query34 15.76 5.114.49 query35 4.534.504.52 query36 0.660.500.49 query37 0.090.060.06 query38 0.050.040.04 query39 0.030.020.02 query40 0.180.130.12 query41 0.080.030.03 query42 0.030.020.03 query43 0.030.030.03 Total cold run time: 106.43 s Total hot run time: 31.07 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (e835f725823 -> a1ae7c3650b)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard e835f725823 Automated deployment with doris branch @ 7032d0abc4ea24e483965036acc9753755adf12c new a1ae7c3650b Automated deployment with doris branch @ 7032d0abc4ea24e483965036acc9753755adf12c This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (e835f725823) \ N -- N -- N refs/heads/asf-site (a1ae7c3650b) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](olap) remove zorder support when create table [doris]
ptallada commented on PR #18698: URL: https://github.com/apache/doris/pull/18698#issuecomment-2698780100 Hi, I cannot find any information about why this feature was removed. Is there any link to any discussion about the reasons? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](index build) Correct inverted index behavior after dynamically adding a column #48389 [doris]
airborne12 merged PR #48546: URL: https://github.com/apache/doris/pull/48546 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-48389-branch-2.1 deleted (was 062a09eacdd)
This is an automated email from the ASF dual-hosted git repository. airborne pushed a change to branch auto-pick-48389-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git was 062a09eacdd fix ut The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-48389-branch-3.0 updated (e04f534289c -> 2dbfe9d95a7)
This is an automated email from the ASF dual-hosted git repository.
airborne pushed a change to branch auto-pick-48389-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
discard e04f534289c [fix](index build) Correct inverted index behavior after
dynamically adding a column (#48389)
add b5937f512d0 branch-3.0: [fix](group commit) group commit support
generated column #48538 (#48582)
add 9b2e203ad11 branch-3.0: [opt](fe) Avoid load
`retrying_service_config.json` multi times for class MetaServiceClient #48487
(#48566)
add 3b55eb56cef branch-3.0: [fix](jdbc test) fix some jdbc catalog test
when cloud mode #48559 (#48584)
add b51d3018258 branch-3.0-pick: [Opt](partial update) Add some cases for
partial update #48161 (#48544)
add 00ea4ad0df2 branch-3.0: [fix](p2) fix the failed of
cold_heat_separation_p2 #48199 (#48516)
add b1a11192072 branch-3.0: [fix](jdbc catalog) Use factory methods to
return mapped types instead 2 #48541 (#48585)
add 2dbfe9d95a7 [fix](index build) Correct inverted index behavior after
dynamically adding a column (#48389)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (e04f534289c)
\
N -- N -- N refs/heads/auto-pick-48389-branch-3.0 (2dbfe9d95a7)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../apache/doris/cloud/rpc/MetaServiceClient.java | 21 ++--
.../datasource/jdbc/client/JdbcMySQLClient.java| 5 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 1 +
.../trees/plans/commands/insert/InsertUtils.java | 3 +-
.../insert_group_commit_with_large_data.out} | Bin 203 -> 221 bytes
.../partial_update/test_partial_update.out | Bin 1839 -> 2031 bytes
...restart.out => test_partial_update_s3_load.out} | Bin 279 -> 363 bytes
.../org/apache/doris/regression/suite/Suite.groovy | 19
.../add_drop_partition.groovy | 18 ++--
.../add_drop_partition_by_hdfs.groovy | 16 +--
.../create_table_use_dynamic_partition.groovy | 16 +--
...eate_table_use_dynamic_partition_by_hdfs.groovy | 14 +--
.../create_table_use_partition_policy.groovy | 28 +++---
...reate_table_use_partition_policy_by_hdfs.groovy | 28 +++---
.../create_table_use_policy.groovy | 20 ++--
.../create_table_use_policy_by_hdfs.groovy | 24 ++---
.../load_colddata_to_hdfs.groovy | 12 +--
.../modify_replica_use_partition.groovy| 44 -
.../modify_replica_use_partition_by_hdfs.groovy| 44 -
.../table_modify_resouce_and_policy.groovy | 24 ++---
.../table_modify_resouce_and_policy_by_hdfs.groovy | 24 ++---
.../jdbc/test_mysql_jdbc_catalog.groovy| 21 ++--
.../ctas/test_mysql_all_types_ctas.groovy | 12 ++-
.../insert_group_commit_with_large_data.groovy | 50 --
.../partial_update/test_partial_update.groovy | 80 +++
.../test_partial_update_s3_load.groovy | 110 +
26 files changed, 442 insertions(+), 192 deletions(-)
copy regression-test/data/{clone_p0/test_decommission_mtmv.out =>
insert_p0/insert_group_commit_with_large_data.out} (57%)
copy
regression-test/data/unique_with_mow_p0/partial_update/{test_partial_update_conflict_be_restart.out
=> test_partial_update_s3_load.out} (53%)
create mode 100644
regression-test/suites/unique_with_mow_p0/partial_update/test_partial_update_s3_load.groovy
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](index build) Correct inverted index behavior after dynamically adding a column #48389 [doris]
airborne12 commented on PR #48547: URL: https://github.com/apache/doris/pull/48547#issuecomment-2699477902 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [test](mv) Fix regression test case to make stable #47880 [doris]
yiguolei merged PR #48262: URL: https://github.com/apache/doris/pull/48262 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: branch-2.1: [test](mv) Fix regression test case to make stable #47880 (#48262)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new ad10da3d7cd branch-2.1: [test](mv) Fix regression test case to make
stable #47880 (#48262)
ad10da3d7cd is described below
commit ad10da3d7cd969cbc1236b37538fad9e12c883af
Author: seawinde
AuthorDate: Wed Mar 5 09:30:18 2025 +0800
branch-2.1: [test](mv) Fix regression test case to make stable #47880
(#48262)
---
.../multi_slot_k1p2ap3ps/multi_slot_k1p2ap3ps.out | Bin 188 -> 242 bytes
.../nereids_rules_p0/mv/partition_mv_rewrite.out | Bin 2790 -> 2856 bytes
.../multi_slot_k1p2ap3ps.groovy| 12 +++-
.../suites/mv_p0/ssb/q_1_1/q_1_1.groovy| 3 +-
.../create_commit_mtmv_many_task.groovy| 2 -
.../range_date_datetrunc_part_up.groovy| 1 +
.../create_part_and_up/range_date_part_up.groovy | 2 +
.../range_date_part_up_rewrite.groovy | 20 ++
.../range_datetime_part_up_rewrite.groovy | 72 ++---
.../mv/partition_mv_rewrite.groovy | 18 ++
10 files changed, 73 insertions(+), 57 deletions(-)
diff --git
a/regression-test/data/mv_p0/multi_slot_k1p2ap3ps/multi_slot_k1p2ap3ps.out
b/regression-test/data/mv_p0/multi_slot_k1p2ap3ps/multi_slot_k1p2ap3ps.out
index 8397a2ecf04..fc5071acb74 100644
Binary files
a/regression-test/data/mv_p0/multi_slot_k1p2ap3ps/multi_slot_k1p2ap3ps.out and
b/regression-test/data/mv_p0/multi_slot_k1p2ap3ps/multi_slot_k1p2ap3ps.out
differ
diff --git a/regression-test/data/nereids_rules_p0/mv/partition_mv_rewrite.out
b/regression-test/data/nereids_rules_p0/mv/partition_mv_rewrite.out
index bf22739583a..c6b66a59749 100644
Binary files
a/regression-test/data/nereids_rules_p0/mv/partition_mv_rewrite.out and
b/regression-test/data/nereids_rules_p0/mv/partition_mv_rewrite.out differ
diff --git
a/regression-test/suites/mv_p0/multi_slot_k1p2ap3ps/multi_slot_k1p2ap3ps.groovy
b/regression-test/suites/mv_p0/multi_slot_k1p2ap3ps/multi_slot_k1p2ap3ps.groovy
index e9fef2a425f..650b93800af 100644
---
a/regression-test/suites/mv_p0/multi_slot_k1p2ap3ps/multi_slot_k1p2ap3ps.groovy
+++
b/regression-test/suites/mv_p0/multi_slot_k1p2ap3ps/multi_slot_k1p2ap3ps.groovy
@@ -33,7 +33,13 @@ suite ("multi_slot_k1p2ap3ps") {
"""
sql "insert into d_table select 1,1,1,'a';"
+sql "insert into d_table select 1,1,1,'a';"
+sql "insert into d_table select 1,1,1,'a';"
+sql "insert into d_table select 2,2,2,'b';"
sql "insert into d_table select 2,2,2,'b';"
+sql "insert into d_table select 2,2,2,'b';"
+sql "insert into d_table select 3,-3,null,'c';"
+sql "insert into d_table select 3,-3,null,'c';"
sql "insert into d_table select 3,-3,null,'c';"
createMV ("create materialized view k1p2ap3ps as select
k1+1,sum(abs(k2+2)+k3+3) from d_table group by k1+1;")
@@ -41,13 +47,13 @@ suite ("multi_slot_k1p2ap3ps") {
sql "insert into d_table select -4,-4,-4,'d';"
sql "analyze table d_table with sync;"
-sql """alter table d_table modify column k1 set stats ('row_count'='5');"""
+sql """alter table d_table modify column k1 set stats
('row_count'='11');"""
sql """set enable_stats=false;"""
-qt_select_star "select * from d_table order by k1;"
+order_qt_select_star "select * from d_table order by k1;"
mv_rewrite_success("select k1+1,sum(abs(k2+2)+k3+3) from d_table group by
k1+1 order by k1+1;", "k1p2ap3ps")
-qt_select_mv "select k1+1,sum(abs(k2+2)+k3+3) from d_table group by k1+1
order by k1+1;"
+order_qt_select_mv "select k1+1,sum(abs(k2+2)+k3+3) from d_table group by
k1+1 order by k1+1;"
sql """set enable_stats=true;"""
mv_rewrite_success("select k1+1,sum(abs(k2+2)+k3+3) from d_table group by
k1+1 order by k1+1;", "k1p2ap3ps")
diff --git a/regression-test/suites/mv_p0/ssb/q_1_1/q_1_1.groovy
b/regression-test/suites/mv_p0/ssb/q_1_1/q_1_1.groovy
index c7aa6e67c6e..5ff94e88522 100644
--- a/regression-test/suites/mv_p0/ssb/q_1_1/q_1_1.groovy
+++ b/regression-test/suites/mv_p0/ssb/q_1_1/q_1_1.groovy
@@ -80,7 +80,7 @@ suite ("mv_ssb_q_1_1") {
(19930101 , 1 , 1 , 1 , 1 , 1 , '1' , 1 , 1 , 1 , 1 , 100 , 1 , 1
, 1 , '2023-06-09' , 'shipmode' , 'name' , 'address' , 'city' , 'nation' ,
'AMERICA' , 'phone' , 'mktsegment' , 'name' , 'address' , 'city' , 'nation' ,
'AMERICA' ,'phone', 'name', 'MFGR#1', 'category', 'brand', 'color', 'type', 4
,'container'),
(19930101 , 1 , 1 , 1 , 1 , 1 , '1' , 1 , 1 , 1 , 1 , 100 , 1 , 1
, 1 , '2023-06-09' , 'shipmode' , 'name' , 'address' , 'city' , 'nation' ,
'AMERICA' , 'phone' , 'mktsegment' , 'name' , 'address' , 'city' , 'nation' ,
'AMERICA' ,'phone', 'name', 'MFGR#1', 'category', 'brand', 'color', 'type', 4
,'container');"""
-sql """alter table li
(doris) branch branch-2.1 updated: branch-2.1: [fix](index build) Correct inverted index behavior after dynamically adding a column #48389 (#48546)
This is an automated email from the ASF dual-hosted git repository.
airborne pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 08e7d920dbc branch-2.1: [fix](index build) Correct inverted index
behavior after dynamically adding a column #48389 (#48546)
08e7d920dbc is described below
commit 08e7d920dbc640f7ff2083ea16057aea7b176a7f
Author: github-actions[bot]
<41898282+github-actions[bot]@users.noreply.github.com>
AuthorDate: Wed Mar 5 09:26:54 2025 +0800
branch-2.1: [fix](index build) Correct inverted index behavior after
dynamically adding a column #48389 (#48546)
Cherry-picked from #48389
-
Co-authored-by: airborne12
---
be/src/olap/task/index_builder.cpp | 11 +-
be/src/olap/task/index_builder.h | 18 +-
be/test/olap/index_builder_test.cpp| 2401
.../test_index_change_on_new_column.out| Bin 245 -> 611 bytes
.../test_index_change_on_new_column.groovy | 90 +-
5 files changed, 2505 insertions(+), 15 deletions(-)
diff --git a/be/src/olap/task/index_builder.cpp
b/be/src/olap/task/index_builder.cpp
index 94feffcc059..a4646a90d04 100644
--- a/be/src/olap/task/index_builder.cpp
+++ b/be/src/olap/task/index_builder.cpp
@@ -389,14 +389,13 @@ Status
IndexBuilder::handle_single_rowset(RowsetMetaSharedPtr output_rowset_meta
}
}
+// DO NOT forget inverted_index_file_writer for the segment,
otherwise, original inverted index will be deleted.
+_inverted_index_file_writers.emplace(seg_ptr->id(),
+
std::move(inverted_index_file_writer));
if (return_columns.empty()) {
// no columns to read
-break;
+continue;
}
-
-_inverted_index_file_writers.emplace(seg_ptr->id(),
-
std::move(inverted_index_file_writer));
-
// create iterator for each segment
StorageReadOptions read_options;
OlapReaderStatistics stats;
@@ -749,10 +748,12 @@ Status IndexBuilder::modify_rowsets(const
Merger::Statistics* stats) {
RETURN_IF_ERROR(_tablet->modify_rowsets(_output_rowsets,
_input_rowsets, true));
}
+#ifndef BE_TEST
{
std::shared_lock rlock(_tablet->get_header_lock());
_tablet->save_meta();
}
+#endif
return Status::OK();
}
diff --git a/be/src/olap/task/index_builder.h b/be/src/olap/task/index_builder.h
index 70fdd6cba2f..2e7924b119e 100644
--- a/be/src/olap/task/index_builder.h
+++ b/be/src/olap/task/index_builder.h
@@ -43,16 +43,16 @@ public:
IndexBuilder(const TabletSharedPtr& tablet, const std::vector&
columns,
const std::vector&
alter_inverted_indexes,
bool is_drop_op = false);
-~IndexBuilder();
+virtual ~IndexBuilder();
-Status init();
-Status do_build_inverted_index();
-Status update_inverted_index_info();
-Status handle_inverted_index_data();
-Status handle_single_rowset(RowsetMetaSharedPtr output_rowset_meta,
-std::vector&
segments);
-Status modify_rowsets(const Merger::Statistics* stats = nullptr);
-void gc_output_rowset();
+virtual Status init();
+virtual Status do_build_inverted_index();
+virtual Status update_inverted_index_info();
+virtual Status handle_inverted_index_data();
+virtual Status handle_single_rowset(RowsetMetaSharedPtr output_rowset_meta,
+
std::vector& segments);
+virtual Status modify_rowsets(const Merger::Statistics* stats = nullptr);
+virtual void gc_output_rowset();
private:
Status _write_inverted_index_data(TabletSchemaSPtr tablet_schema, int32_t
segment_idx,
diff --git a/be/test/olap/index_builder_test.cpp
b/be/test/olap/index_builder_test.cpp
new file mode 100644
index 000..d29f09a25c7
--- /dev/null
+++ b/be/test/olap/index_builder_test.cpp
@@ -0,0 +1,2401 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing per
Re: [PR] branch 3.0: [fix](regression) topn-filter unstable case #47797 [doris]
englefly commented on PR #48367: URL: https://github.com/apache/doris/pull/48367#issuecomment-2699511182 run performance -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] format [doris]
hello-stephen commented on PR #48658: URL: https://github.com/apache/doris/pull/48658#issuecomment-2699519662 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] format [doris]
Gabriel39 merged PR #48658: URL: https://github.com/apache/doris/pull/48658 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix] (inverted index) Fix UTF-8 4-byte truncation issue and add configuration to control correct term writing [doris]
airborne12 opened a new pull request, #48657: URL: https://github.com/apache/doris/pull/48657 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix] (inverted index) Fix UTF-8 4-byte truncation issue and add configuration to control correct term writing [doris]
hello-stephen commented on PR #48657: URL: https://github.com/apache/doris/pull/48657#issuecomment-2699498097 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](nereids)extract in-predicate from filter conditions [doris]
englefly closed pull request #44023: [feat](nereids)extract in-predicate from filter conditions URL: https://github.com/apache/doris/pull/44023 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (52243d457bc -> 9270f45ba47)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 52243d457bc Automated deployment with doris branch @ 7032d0abc4ea24e483965036acc9753755adf12c new 9270f45ba47 Automated deployment with doris branch @ 7032d0abc4ea24e483965036acc9753755adf12c This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (52243d457bc) \ N -- N -- N refs/heads/asf-site (9270f45ba47) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0-pick: [Opt](merge-on-write) Check delete bitmap cache after writing it (#48233) [doris]
bobhan1 commented on PR #48493: URL: https://github.com/apache/doris/pull/48493#issuecomment-2699558570 run beut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](inverted index) Fix for Inaccurate match_phrase_prefix Cache in Query Processing [doris]
yiguolei commented on PR #48604: URL: https://github.com/apache/doris/pull/48604#issuecomment-2699574219 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: branch-2.1-pick: [compaction](config) Add a config to control whether to prune rows with delete sign=1 in base compaction (#48241) (#48620)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 74b85d6bffe branch-2.1-pick: [compaction](config) Add a config to
control whether to prune rows with delete sign=1 in base compaction (#48241)
(#48620)
74b85d6bffe is described below
commit 74b85d6bffe49e9390e2ec26e92e7c366fd8c61d
Author: bobhan1
AuthorDate: Wed Mar 5 10:10:58 2025 +0800
branch-2.1-pick: [compaction](config) Add a config to control whether to
prune rows with delete sign=1 in base compaction (#48241) (#48620)
pick https://github.com/apache/doris/pull/48241
---
be/src/common/config.cpp | 4 +
be/src/common/config.h | 4 +
be/src/olap/tablet_reader.cpp | 3 +-
.../compaction/test_config_prune_delete_sign.out | Bin 0 -> 163 bytes
.../test_config_prune_delete_sign.groovy | 89 +
5 files changed, 99 insertions(+), 1 deletion(-)
diff --git a/be/src/common/config.cpp b/be/src/common/config.cpp
index 1f81e646045..987f09f3433 100644
--- a/be/src/common/config.cpp
+++ b/be/src/common/config.cpp
@@ -1360,6 +1360,10 @@
DEFINE_mBool(enable_sleep_between_delete_cumu_compaction, "false");
DEFINE_mInt32(compaction_num_per_round, "1");
+// whether to prune rows with delete sign = 1 in base compaction
+// ATTN: this config is only for test
+DEFINE_mBool(enable_prune_delete_sign_when_base_compaction, "true");
+
// clang-format off
#ifdef BE_TEST
// test s3
diff --git a/be/src/common/config.h b/be/src/common/config.h
index afad2cac7e7..b11534a6e40 100644
--- a/be/src/common/config.h
+++ b/be/src/common/config.h
@@ -1432,6 +1432,10 @@ DECLARE_mInt32(compaction_num_per_round);
// Enable sleep 5s between delete cumulative compaction.
DECLARE_mBool(enable_sleep_between_delete_cumu_compaction);
+// whether to prune rows with delete sign = 1 in base compaction
+// ATTN: this config is only for test
+DECLARE_mBool(enable_prune_delete_sign_when_base_compaction);
+
#ifdef BE_TEST
// test s3
DECLARE_String(test_s3_resource);
diff --git a/be/src/olap/tablet_reader.cpp b/be/src/olap/tablet_reader.cpp
index 51b2384bc90..0a9f7119ffe 100644
--- a/be/src/olap/tablet_reader.cpp
+++ b/be/src/olap/tablet_reader.cpp
@@ -628,7 +628,8 @@ Status TabletReader::_init_delete_condition(const
ReaderParams& read_params) {
// Only BASE_COMPACTION and COLD_DATA_COMPACTION and CUMULATIVE_COMPACTION
need set filter_delete = true
// other reader type:
// QUERY will filter the row in query layer to keep right result use where
clause.
-_filter_delete = (read_params.reader_type ==
ReaderType::READER_BASE_COMPACTION ||
+_filter_delete = ((read_params.reader_type ==
ReaderType::READER_BASE_COMPACTION &&
+ config::enable_prune_delete_sign_when_base_compaction)
||
read_params.reader_type ==
ReaderType::READER_COLD_DATA_COMPACTION ||
((read_params.reader_type ==
ReaderType::READER_CUMULATIVE_COMPACTION &&
config::enable_delete_when_cumu_compaction)) ||
diff --git a/regression-test/data/compaction/test_config_prune_delete_sign.out
b/regression-test/data/compaction/test_config_prune_delete_sign.out
new file mode 100644
index 000..9bbb4251318
Binary files /dev/null and
b/regression-test/data/compaction/test_config_prune_delete_sign.out differ
diff --git
a/regression-test/suites/compaction/test_config_prune_delete_sign.groovy
b/regression-test/suites/compaction/test_config_prune_delete_sign.groovy
new file mode 100644
index 000..06c56ce6405
--- /dev/null
+++ b/regression-test/suites/compaction/test_config_prune_delete_sign.groovy
@@ -0,0 +1,89 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+suite("test_config_prune_delete_sign", "nonConcurrent") {
+
+def inspectRows = { sqlStr ->
+sql "set skip_delete_sign=true;"
+sql "set skip_delete_bitmap=true;"
+sql "sync"
+qt_inspect sqlStr
+sql "set skip_delete_sign=f
Re: [PR] [Enhancement-2.1](log) Reduce INFO log size by changing some routine query log to VLOG [doris]
yiguolei merged PR #48293: URL: https://github.com/apache/doris/pull/48293 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](cold hot separation) Fix the issue that files on the remote storage are not deleted after triggering cold data compaction. (#48109) [doris]
yiguolei commented on PR #48446: URL: https://github.com/apache/doris/pull/48446#issuecomment-2699578649 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated (be6210d742e -> 1b0bb4010b4)
This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a change to branch branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git from be6210d742e branch-2.1: [improve](load) improve error message "unknown load_id" #47509 (#48639) add 1b0bb4010b4 [Enhancement-2.1](log) Reduce INFO log size by changing some routine query log to VLOG (#48293) No new revisions were added by this update. Summary of changes: be/src/runtime/fragment_mgr.cpp | 45 ++-- be/src/runtime/query_context.cpp | 4 ++-- 2 files changed, 22 insertions(+), 27 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improve](audit) sql that fails to be syntax parsed is not audited [doris]
doris-robot commented on PR #48527: URL: https://github.com/apache/doris/pull/48527#issuecomment-2699582530 TPC-DS: Total hot run time: 190880 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 15799878a31ad520af9a56cad5a06b683fedfc45, data reload: false query1 1306978 926 926 query2 6236189118441844 query3 11019 430243554302 query4 54239 25178 22995 22995 query5 5246523 478 478 query6 347 209 189 189 query7 4953523 298 298 query8 320 245 234 234 query9 5955265626482648 query10 425 321 250 250 query11 15542 15135 14822 14822 query12 163 109 114 109 query13 1089526 405 405 query14 10931 706270107010 query15 210 186 182 182 query16 7003668 515 515 query17 1094783 611 611 query18 1074401 358 358 query19 208 192 165 165 query20 135 135 120 120 query21 213 135 103 103 query22 4357444044494440 query23 34169 33264 33581 33264 query24 5832246024342434 query25 486 462 415 415 query26 746 281 155 155 query27 1836517 334 334 query28 3069247624382438 query29 548 549 429 429 query30 224 187 154 154 query31 924 872 838 838 query32 76 62 58 58 query33 471 350 309 309 query34 771 880 510 510 query35 795 827 734 734 query36 963 993 900 900 query37 125 99 71 71 query38 4172430743294307 query39 1471139714711397 query40 204 124 107 107 query41 52 53 51 51 query42 126 102 115 102 query43 504 493 477 477 query44 1344813 812 812 query45 189 199 169 169 query46 878 1054650 650 query47 1816187818191819 query48 398 444 306 306 query49 752 495 438 438 query50 706 751 414 414 query51 4233427742764276 query52 112 105 93 93 query53 227 254 190 190 query54 496 500 439 439 query55 82 79 77 77 query56 294 290 270 270 query57 1166117111291129 query58 260 236 247 236 query59 2638274326052605 query60 287 292 270 270 query61 121 122 133 122 query62 735 750 702 702 query63 237 192 193 192 query64 22711041736 736 query65 3326328832273227 query66 717 386 302 302 query67 15802 15520 15381 15381 query68 7199889 509 509 query69 538 325 252 252 query70 1208115611031103 query71 489 286 258 258 query72 5592358737353587 query73 1405733 357 357 query74 8956903889348934 query75 3677315027202720 query76 42961178750 750 query77 600 373 289 289 query78 990910214 91449144 query79 1527828 597 597 query80 835 539 450 450 query81 509 278 236 236 query82 654 128 106 106 query83 329 173 207 173 query84 284 86 74 74 query85 806 367 307 307 query86 377 296 279 279 query87 4706459244654465 query88 2899223222092209 query89 412 324 280 280 query90 1864195 193 193 query91 140 140 108 108 query92 78 65 59 59 query93 11811046581 581 query94 702 383 300 300 query95 418 272 254 254 query96 496 568 266 266 query97 3360335532443244 query98 218 203 197 197 query99 1458136112561256 Total cold run time: 295838 ms Total hot run time: 190880 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t
(doris) branch branch-3.0 updated: [fix](beut) fix the unit test for calculating the compaction score (#48660)
This is an automated email from the ASF dual-hosted git repository.
hellostephen pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new 643698bd01b [fix](beut) fix the unit test for calculating the
compaction score (#48660)
643698bd01b is described below
commit 643698bd01bc2828a369d4469c400ea6eb8f6327
Author: Luwei
AuthorDate: Wed Mar 5 11:05:41 2025 +0800
[fix](beut) fix the unit test for calculating the compaction score (#48660)
---
be/test/olap/tablet_mgr_test.cpp | 20
1 file changed, 16 insertions(+), 4 deletions(-)
diff --git a/be/test/olap/tablet_mgr_test.cpp b/be/test/olap/tablet_mgr_test.cpp
index 02a197d43e0..7b940ffa0fa 100644
--- a/be/test/olap/tablet_mgr_test.cpp
+++ b/be/test/olap/tablet_mgr_test.cpp
@@ -482,7 +482,10 @@ TEST_F(TabletMgrTest, FindTabletWithCompact) {
int index = 0;
for (auto t : compact_tablets) {
ASSERT_EQ(t->tablet_id(), 10100 - index);
-ASSERT_EQ(t->calc_compaction_score(), 100 - index);
+ASSERT_EQ(t->calc_compaction_score(
+ CompactionType::CUMULATIVE_COMPACTION,
+
cumulative_compaction_policies[CUMULATIVE_SIZE_BASED_POLICY]),
+ 100 - index - 1);
index++;
}
config::compaction_num_per_round = 1;
@@ -506,10 +509,16 @@ TEST_F(TabletMgrTest, FindTabletWithCompact) {
ASSERT_EQ(compact_tablets.size(), 11);
for (int i = 0; i < 10; ++i) {
ASSERT_EQ(compact_tablets[i]->tablet_id(), 20100 - i);
-ASSERT_EQ(compact_tablets[i]->calc_compaction_score(), 100 - i);
+ASSERT_EQ(compact_tablets[i]->calc_compaction_score(
+ CompactionType::CUMULATIVE_COMPACTION,
+
cumulative_compaction_policies[CUMULATIVE_SIZE_BASED_POLICY]),
+ 100 - i - 1);
}
ASSERT_EQ(compact_tablets[10]->tablet_id(), 20102);
-ASSERT_EQ(compact_tablets[10]->calc_compaction_score(), 200);
+ASSERT_EQ(compact_tablets[10]->calc_compaction_score(
+ CompactionType::CUMULATIVE_COMPACTION,
+
cumulative_compaction_policies[CUMULATIVE_SIZE_BASED_POLICY]),
+ 200 - 1);
config::compaction_num_per_round = 1;
// drop all tablets
@@ -534,7 +543,10 @@ TEST_F(TabletMgrTest, FindTabletWithCompact) {
ASSERT_EQ(compact_tablets.size(), 5);
for (int i = 0; i < 5; ++i) {
ASSERT_EQ(compact_tablets[i]->tablet_id(), 3 + 5 - i);
-ASSERT_EQ(compact_tablets[i]->calc_compaction_score(), 10 - i);
+ASSERT_EQ(compact_tablets[i]->calc_compaction_score(
+ CompactionType::CUMULATIVE_COMPACTION,
+
cumulative_compaction_policies[CUMULATIVE_SIZE_BASED_POLICY]),
+ 10 - i - 1);
}
config::compaction_num_per_round = 1;
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improve](audit) sql that fails to be syntax parsed is not audited [doris]
dqz123 commented on PR #48527: URL: https://github.com/apache/doris/pull/48527#issuecomment-2699656818 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](beut) fix the unit test for calculating the compaction score [doris]
hello-stephen merged PR #48660: URL: https://github.com/apache/doris/pull/48660 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-48632-branch-3.0 created (now b1a11192072)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-48632-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at b1a11192072 branch-3.0: [fix](jdbc catalog) Use factory methods to return mapped types instead 2 #48541 (#48585) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-48632-branch-2.1 updated (1b0bb4010b4 -> 659d0013767)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-48632-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git from 1b0bb4010b4 [Enhancement-2.1](log) Reduce INFO log size by changing some routine query log to VLOG (#48293) add 659d0013767 [Fix](case) Fix case `test_partial_update_with_delete_col_in_publish` (#48632) No new revisions were added by this update. Summary of changes: .../test_partial_update_with_delete_col_in_publish.groovy | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement] (nereids) support show data command [doris]
starocean999 merged PR #48629: URL: https://github.com/apache/doris/pull/48629 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Enhancement] (nereids)implement showColumnHistogramStatsCommand in nereids [doris]
starocean999 closed issue #42718: [Enhancement] (nereids)implement showColumnHistogramStatsCommand in nereids URL: https://github.com/apache/doris/issues/42718 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: (test)[auth]Add call auth module case #42345 [doris]
github-actions[bot] commented on PR #48640: URL: https://github.com/apache/doris/pull/48640#issuecomment-2699594625 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement] (nereids)implement showStoragePolicyCommand in nereids [doris]
starocean999 merged PR #44393: URL: https://github.com/apache/doris/pull/44393 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement] (nereids) support show column histogram command [doris]
starocean999 merged PR #48587: URL: https://github.com/apache/doris/pull/48587 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (5b12f0e5d0d -> b4f8fcd44da)
This is an automated email from the ASF dual-hosted git repository.
starocean999 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 5b12f0e5d0d [Enhancement] (nereids) support show data command (#48629)
add b4f8fcd44da [Enhancement] (nereids)implement showStoragePolicyCommand
in nereids (#44393)
No new revisions were added by this update.
Summary of changes:
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 2 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 11
.../apache/doris/nereids/trees/plans/PlanType.java | 1 +
...tCommand.java => ShowStoragePolicyCommand.java} | 53 +++-
.../trees/plans/visitor/CommandVisitor.java| 5 ++
.../java/org/apache/doris/policy/PolicyMgr.java| 74 ++
.../test_show_storage_policy_nereids.groovy} | 12 ++--
7 files changed, 96 insertions(+), 62 deletions(-)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/{ShowDiagnoseTabletCommand.java
=> ShowStoragePolicyCommand.java} (59%)
copy
regression-test/suites/nereids_p0/{test_drop_storage_policy_command.groovy =>
show/test_show_storage_policy_nereids.groovy} (87%)
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[PR] branch-3.0-pick: [Fix](mow) Fix some logs for mow (#48523) [doris]
bobhan1 opened a new pull request, #48664: URL: https://github.com/apache/doris/pull/48664 pick https://github.com/apache/doris/pull/48523 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (b4f8fcd44da -> 81886fa476f)
This is an automated email from the ASF dual-hosted git repository.
starocean999 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from b4f8fcd44da [Enhancement] (nereids)implement showStoragePolicyCommand
in nereids (#44393)
add 81886fa476f [Enhancement] (nereids) support show column histogram
command (#48587)
No new revisions were added by this update.
Summary of changes:
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 4 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 9 +++
.../apache/doris/nereids/trees/plans/PlanType.java | 1 +
.../commands/ShowColumnHistogramStatsCommand.java} | 80 +++---
.../trees/plans/visitor/CommandVisitor.java| 6 ++
.../doris/statistics/StatisticsRepository.java | 2 +-
6 files changed, 73 insertions(+), 29 deletions(-)
copy
fe/fe-core/src/main/java/org/apache/doris/{analysis/ShowColumnHistStmt.java =>
nereids/trees/plans/commands/ShowColumnHistogramStatsCommand.java} (69%)
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improvement](column) add santy check and add some fix for ColumnString #47964 [doris]
BiteThet commented on PR #48513: URL: https://github.com/apache/doris/pull/48513#issuecomment-2699674775 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improve](routine load) add more metrics to observe the routine load job [doris]
sollhui commented on PR #48209: URL: https://github.com/apache/doris/pull/48209#issuecomment-2699672673 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0-pick: [Fix](mow) Fix some logs for mow (#48523) [doris]
bobhan1 commented on PR #48664: URL: https://github.com/apache/doris/pull/48664#issuecomment-2699672093 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] 1 [doris]
Thearas commented on PR #48668: URL: https://github.com/apache/doris/pull/48668#issuecomment-2699689572 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] 1 [doris]
zddr opened a new pull request, #48668: URL: https://github.com/apache/doris/pull/48668 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Enhancement] (nereids)implement showStoragePolicyCommand in nereids [doris]
starocean999 closed issue #42721: [Enhancement] (nereids)implement showStoragePolicyCommand in nereids URL: https://github.com/apache/doris/issues/42721 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (49145612619 -> 5b12f0e5d0d)
This is an automated email from the ASF dual-hosted git repository.
starocean999 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 49145612619 [fix](nereids) derive sum() column stats as UNKNOWN
(#48397)
add 5b12f0e5d0d [Enhancement] (nereids) support show data command (#48629)
No new revisions were added by this update.
Summary of changes:
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 4 +-
.../mysql/privilege/AccessControllerManager.java | 6 ++
.../doris/nereids/parser/LogicalPlanBuilder.java | 17
.../apache/doris/nereids/trees/plans/PlanType.java | 1 +
.../trees/plans/commands/ShowDataCommand.java} | 106 +
.../trees/plans/commands/info/TableNameInfo.java | 9 ++
.../trees/plans/visitor/CommandVisitor.java| 5 +
7 files changed, 106 insertions(+), 42 deletions(-)
copy fe/fe-core/src/main/java/org/apache/doris/{analysis/ShowDataStmt.java =>
nereids/trees/plans/commands/ShowDataCommand.java} (90%)
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](inverted index) refactor code structure and improve pointer null checks [doris]
zzzxl1993 commented on PR #48371: URL: https://github.com/apache/doris/pull/48371#issuecomment-2699693669 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](inverted index) refactor code structure and improve pointer null checks [doris]
github-actions[bot] commented on PR #48371: URL: https://github.com/apache/doris/pull/48371#issuecomment-2699696951 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](inverted index) refactor code structure and improve pointer null checks [doris]
github-actions[bot] commented on PR #48371: URL: https://github.com/apache/doris/pull/48371#issuecomment-2699696993 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](inverted index) Fix for Inaccurate match_phrase_prefix Cache in Query Processing [doris]
zzzxl1993 commented on PR #48604: URL: https://github.com/apache/doris/pull/48604#issuecomment-2699696190 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0-pick: [Fix](cloud) Should consider tablet state change whether to skip `sync_rowsets` in publish phase (#48400) [doris]
Thearas commented on PR #48667: URL: https://github.com/apache/doris/pull/48667#issuecomment-2699679526 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](ci) 3.0 add require check - performance [doris]
Thearas commented on PR #48669: URL: https://github.com/apache/doris/pull/48669#issuecomment-2699698682 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [chore](ci) 3.0 add require check - performance [doris]
hello-stephen opened a new pull request, #48669: URL: https://github.com/apache/doris/pull/48669 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [chore](meta) Add rocksdb perf/io context for debug [doris]
w41ter opened a new pull request, #48670: URL: https://github.com/apache/doris/pull/48670 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-website) branch asf-site updated (1b9fe92356e -> 98d756ee640)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/doris-website.git discard 1b9fe92356e Automated deployment with doris branch @ 7032d0abc4ea24e483965036acc9753755adf12c new 98d756ee640 Automated deployment with doris branch @ 7032d0abc4ea24e483965036acc9753755adf12c This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (1b9fe92356e) \ N -- N -- N refs/heads/asf-site (98d756ee640) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: docs/2.0/search-index.json | 2 +- docs/3.0/search-index.json | 2 +- docs/dev/search-index.json | 2 +- search-index.json| 2 +- zh-CN/docs/2.0/search-index.json | 2 +- zh-CN/docs/3.0/search-index.json | 2 +- zh-CN/docs/dev/search-index.json | 2 +- zh-CN/search-index.json | 2 +- 8 files changed, 8 insertions(+), 8 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0-pick: [Fix](cloud) Should consider tablet state change whether to skip `sync_rowsets` in publish phase (#48400) [doris]
bobhan1 commented on PR #48667: URL: https://github.com/apache/doris/pull/48667#issuecomment-2699681093 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](inverted index) refactor code structure and improve pointer null checks [doris]
zzzxl1993 commented on code in PR #48371:
URL: https://github.com/apache/doris/pull/48371#discussion_r1980626324
##
be/src/vec/functions/function_multi_match.cpp:
##
@@ -69,25 +70,32 @@ Status FunctionMultiMatch::evaluate_inverted_index(
"parameter query type incorrect for function multi_match:
query_type = {}",
query_type);
}
+
// query
auto query_str = arguments[1].column->get_data_at(0);
auto param_type = arguments[1].type->get_type_as_type_descriptor().type;
if (!is_string_type(param_type)) {
return Status::Error(
"arguments for multi_match must be string");
}
+
// search
-for (int i = 0; i < data_type_with_names.size(); i++) {
+for (size_t i = 0; i < data_type_with_names.size(); i++) {
auto column_name = data_type_with_names[i].first;
auto* iter = iterators[i];
+if (iter == nullptr) {
+return Status::Error(
+"inverted index iterator is null");
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) divide const folding for decimalv3 return type is not correct [doris]
doris-robot commented on PR #48641: URL: https://github.com/apache/doris/pull/48641#issuecomment-2699702328 TPC-H: Total hot run time: 32263 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 48dbe61d9dcb33ae857e7d983e1b683a160867a6, data reload: false -- Round 1 -- q1 17636 536252165216 q2 2056312 173 173 q3 10534 1265810 810 q4 10235 1067551 551 q5 7647241923752375 q6 203 164 130 130 q7 932 760 630 630 q8 9295133712181218 q9 5014476147714761 q10 6856233319181918 q11 488 286 259 259 q12 358 365 235 235 q13 17766 373431473147 q14 226 229 208 208 q15 522 469 445 445 q16 634 618 595 595 q17 600 900 358 358 q18 6908609461986094 q19 1979973 588 588 q20 327 331 192 192 q21 2739247920472047 q22 377 369 313 313 Total cold run time: 103332 ms Total hot run time: 32263 ms - Round 2, with runtime_filter_mode=off - q1 5320526552615261 q2 248 342 246 246 q3 2141270722642264 q4 1551190414261426 q5 4274415742084157 q6 209 161 126 126 q7 1914193117911791 q8 2660272525782578 q9 7270717671447144 q10 3061319028132813 q11 587 521 477 477 q12 703 797 638 638 q13 3416391733203320 q14 296 296 271 271 q15 514 471 469 469 q16 642 678 647 647 q17 1185163113711371 q18 7640733674297336 q19 900 869 970 869 q20 1954208519081908 q21 5739506149234923 q22 643 589 543 543 Total cold run time: 52867 ms Total hot run time: 50578 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](meta) Add rocksdb perf/io context for debug [doris]
hello-stephen commented on PR #48670: URL: https://github.com/apache/doris/pull/48670#issuecomment-2699703622 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch hello-stephen-patch-4 created (now e38b1c428f1)
This is an automated email from the ASF dual-hosted git repository. hellostephen pushed a change to branch hello-stephen-patch-4 in repository https://gitbox.apache.org/repos/asf/doris.git at e38b1c428f1 [chore](ci) 3.0 add require check - performance This branch includes the following new commits: new e38b1c428f1 [chore](ci) 3.0 add require check - performance The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](icu) enforce MAX_WORD_LEN constraint for ICU tokenized terms [doris]
github-actions[bot] commented on PR #48381: URL: https://github.com/apache/doris/pull/48381#issuecomment-2699710104 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](inverted index) Added Error Check for Zero File Read Result [doris]
qidaye commented on code in PR #48666:
URL: https://github.com/apache/doris/pull/48666#discussion_r1980638681
##
be/src/olap/rowset/segment_v2/inverted_index_fs_directory.cpp:
##
@@ -221,6 +221,13 @@ void DorisFSDirectory::FSIndexInput::readInternal(uint8_t*
b, const int32_t len)
if (!st.ok()) {
_CLTHROWA(CL_ERR_IO, "read past EOF");
}
+if (bytes_read == 0) {
Review Comment:
Add tests
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix][cloud] Prevent fe CloudReplica.getBackendIdImpl consuming too mā¦ [doris]
deardeng commented on code in PR #48564:
URL: https://github.com/apache/doris/pull/48564#discussion_r1980638295
##
fe/fe-core/src/main/java/org/apache/doris/catalog/ColocateTableIndex.java:
##
@@ -176,7 +176,7 @@ public static boolean isGlobalGroupName(String groupName) {
private Multimap group2Tables = ArrayListMultimap.create();
// table_id -> group_id
@SerializedName(value = "table2Group")
-private Map table2Group = Maps.newHashMap();
+private Map table2Group = Maps.newConcurrentMap();
Review Comment:
ColocateTableIndex not use gson serializationļ¼ ColocateTableIndex still use
the old way of serialization
@LiBinfeng-01 add this
`@SerializedName(value = "table2Group")
`
just for planner minidump.
So there's no problem here
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](icu) enforce MAX_WORD_LEN constraint for ICU tokenized terms [doris]
github-actions[bot] commented on PR #48381: URL: https://github.com/apache/doris/pull/48381#issuecomment-2699710079 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] 1 [doris]
zddr commented on PR #48668: URL: https://github.com/apache/doris/pull/48668#issuecomment-2699689838 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](memory) Fix `SwitchResourceContext` when thread context no attach task [doris]
xinyiZzz opened a new pull request, #48671: URL: https://github.com/apache/doris/pull/48671 ### What problem does this PR solve? #48429 not completely fixed fix: ``` thread_context.h:201] Check failed: is_attach_task() *** Check failure stack trace: ***@ 0x55baa6559996 google::LogMessage::SendToLog()@ 0x55baa65563e0 google::LogMessage::Flush()@ 0x55baa655a1d9 google::LogMessageFatal::~LogMessageFatal()@ 0x55ba9c250f71 doris::SwitchResourceContext::SwitchResourceContext()@ 0x55ba9bb983e9 doris::MemTableWriter::flush_async()@ 0x55ba9bb90040 doris::MemTableMemoryLimiter::_flush_active_memtables()@ 0x55ba9bb8eea3 doris::MemTableMemoryLimiter::_handle_memtable_flush()@ 0x55ba9bb8e63c doris::MemTableMemoryLimiter::handle_workload_group_memtable_flush()@ 0x55ba9c15780e doris::LoadChannelMgr::add_batch()@ 0x55ba9c2ce9a1 std::_Function_handler<>::_M_invoke()@ 0x55ba9c2e8b2b doris::WorkThreadPool<>::work_thread()@ 0x55baa957fed0 execute_native_thread_routine@ 0x7ff33bc91ac3 (unknown)@ 0x7ff33bd23850 (unknown)@ (n il) (unknown)*** Query id: 7427761ba9d1470d-91c666c0d5bb756e ** is nereids: 0 ** tablet id: 0 ** Aborted at 1741115991 (unix time) try "date -d @1741115991" if you are using GNU date ** Current BE git commitID: 09cbc482fb ** SIGABRT unknown detail explain (@0x765d) received by PID 30301 (TID 31028 OR 0x7ff1a0242640) from PID 30301; stack trace: *** 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_master/doris/be/src/common/signal_handler.h:421 1# 0x7FF33BC3F520 in /lib/x86_64-linux-gnu/libc.so.6 2# pthread_kill at ./nptl/pthread_kill.c:89 3# raise at ../sysdeps/posix/raise.c:27 4# abort at ./stdlib/abort.c:81 5# 0x55BAA656426D in /mnt/hdd01/PERFORMANCE_ENV/be/lib/doris_be 6# 0x55BAA65568AA in /mnt/hdd01/PERFORMANCE_ENV/be/lib/doris_be 7# google::LogMessage::SendToLog() in /mnt/hdd01/PERFORMANCE_ENV/be/lib/doris_be 8# google::LogMessage::Flush() in /mnt/hdd01/PERFORMANCE_ENV/be/lib/do ris_be 9# google::LogMessageFatal::~LogMessageFatal() in /mnt/hdd01/PERFORMANCE_ENV/be/lib/doris_be10# doris::SwitchResourceContext::SwitchResourceContext(std::shared_ptr const&) in /mnt/hdd01/PERFORMANCE_ENV/be/lib/doris_be11# doris::MemTableWriter::flush_async() at /home/zcp/repo_center/doris_master/doris/be/src/olap/memtable_writer.cpp:16012# doris::MemTableMemoryLimiter::_flush_active_memtables(unsigned long, long) at /home/zcp/repo_center/doris_master/doris/be/src/olap/memtable_memory_limiter.cpp:26213# doris::MemTableMemoryLimiter::_handle_memtable_flush(std::shared_ptr) at /home/zcp/repo_center/doris_master/doris/be/src/olap/memtable_memory_limiter.cpp:17814# doris::MemTableMemoryLimiter::handle_workload_group_memtable_flush(std::shared_ptr) at /home/zcp/repo_center/doris_master/doris/be/src/olap/memtable_memory_limiter.cpp:13615# `` ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](log) Fix s3_rate_limiter.cpp LOG incomplete #48440 [doris]
github-actions[bot] commented on PR #48643: URL: https://github.com/apache/doris/pull/48643#issuecomment-2699712306 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](log) Fix s3_rate_limiter.cpp LOG incomplete #48440 [doris]
github-actions[bot] commented on PR #48643: URL: https://github.com/apache/doris/pull/48643#issuecomment-2699712348 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) divide const folding for decimalv3 return type is not correct [doris]
doris-robot commented on PR #48641: URL: https://github.com/apache/doris/pull/48641#issuecomment-2699717506 TPC-DS: Total hot run time: 190662 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 48dbe61d9dcb33ae857e7d983e1b683a160867a6, data reload: false query1 1299932 953 932 query2 6231185918271827 query3 11168 466046424642 query4 25406 23651 22972 22972 query5 4526677 530 530 query6 306 207 195 195 query7 3986509 300 300 query8 297 258 239 239 query9 8524262226312622 query10 466 324 263 263 query11 15652 15051 14804 14804 query12 167 107 110 107 query13 1577556 399 399 query14 9796642469666424 query15 206 188 206 188 query16 7638638 483 483 query17 1196754 610 610 query18 2030433 325 325 query19 206 218 174 174 query20 127 124 122 122 query21 208 127 109 109 query22 4612460144314431 query23 34427 4 33600 4 query24 7702248624592459 query25 533 469 401 401 query26 1186281 155 155 query27 2175508 337 337 query28 4385247324462446 query29 650 596 429 429 query30 222 199 160 160 query31 932 886 812 812 query32 70 62 70 62 query33 542 378 314 314 query34 821 933 536 536 query35 811 894 770 770 query36 959 1011914 914 query37 122 103 78 78 query38 4073425242384238 query39 1472147114391439 query40 212 122 103 103 query41 53 51 50 50 query42 133 108 103 103 query43 498 519 481 481 query44 1401818 811 811 query45 184 183 173 173 query46 930 1100671 671 query47 1814183917611761 query48 398 439 307 307 query49 765 540 428 428 query50 760 811 434 434 query51 4299433543184318 query52 116 110 94 94 query53 241 278 194 194 query54 493 528 410 410 query55 82 84 79 79 query56 270 281 266 266 query57 1159117010881088 query58 249 262 247 247 query59 2679279326672667 query60 300 274 271 271 query61 121 117 119 117 query62 815 746 689 689 query63 232 201 212 201 query64 36471010663 663 query65 3348326332163216 query66 844 391 303 303 query67 16278 15601 15288 15288 query68 9763907 505 505 query69 473 292 265 265 query70 121710661066 query71 491 304 284 284 query72 5093361638453616 query73 786 755 359 359 query74 9000904289488948 query75 4226320027162716 query76 40191186780 780 query77 982 391 276 276 query78 993510089 92099209 query79 2082848 600 600 query80 607 532 461 461 query81 484 283 240 240 query82 241 133 98 98 query83 169 174 156 156 query84 282 137 74 74 query85 742 345 304 304 query86 342 310 282 282 query87 4498440843604360 query88 2964226622322232 query89 423 319 294 294 query90 2118194 195 194 query91 131 140 108 108 query92 68 59 54 54 query93 18451038580 580 query94 666 413 291 291 query95 356 267 255 255 query96 493 569 276 276 query97 3294335332953295 query98 231 217 204 204 query99 1381142212651265 Total cold run time: 278429 ms Total hot run time: 190662 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to
Re: [PR] branch-3.0-pick: [Fix](mow) Fix some logs for mow (#48523) [doris]
Thearas commented on PR #48664: URL: https://github.com/apache/doris/pull/48664#issuecomment-2699671102 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Fix `SwitchResourceContext` when thread context no attach task [doris]
Thearas commented on PR #48671: URL: https://github.com/apache/doris/pull/48671#issuecomment-2699710662 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR). Please clearly describe your PR: 1. What problem was fixed (it's best to include specific error reporting information). How it was fixed. 2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be. 3. What features were added. Why was this function added? 4. Which code was refactored and why was this part of the code refactored? 5. Which functions were optimized and what is the difference before and after the optimization? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch 3.0: [fix](regression) topn-filter unstable case #47797 [doris]
github-actions[bot] commented on PR #48367: URL: https://github.com/apache/doris/pull/48367#issuecomment-2699716132 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch 3.0: [fix](regression) topn-filter unstable case #47797 [doris]
github-actions[bot] commented on PR #48367: URL: https://github.com/apache/doris/pull/48367#issuecomment-2699716181 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Enhancement] (nereids)implement showStoragePolicyCommand in nereids [doris]
starocean999 closed issue #42721: [Enhancement] (nereids)implement showStoragePolicyCommand in nereids URL: https://github.com/apache/doris/issues/42721 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](kerberos)Add hdfs(tvf),outfile and export test [doris]
github-actions[bot] commented on PR #48433: URL: https://github.com/apache/doris/pull/48433#issuecomment-2699719240 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [test](kerberos)Add hdfs(tvf),outfile and export test [doris]
github-actions[bot] commented on PR #48433: URL: https://github.com/apache/doris/pull/48433#issuecomment-2699719266 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0-pick: [Fix](cloud) Should consider tablet state change whether to skip `sync_rowsets` in publish phase (#48400) [doris]
doris-robot commented on PR #48667: URL: https://github.com/apache/doris/pull/48667#issuecomment-2699730572 TeamCity cloud ut coverage result: Function Coverage: 82.26% (1062/1291) Line Coverage: 65.76% (17617/26790) Region Coverage: 65.27% (8677/13294) Branch Coverage: 55.25% (4683/8476) Coverage Report: http://coverage.selectdb-in.cc/coverage/8ce0f46e64734d8e4fcadfc8ebeada36d22e1e77_8ce0f46e64734d8e4fcadfc8ebeada36d22e1e77_cloud/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [Bug](compile) fix compile error in master branch about GCC #42936 [doris]
doris-robot commented on PR #48665: URL: https://github.com/apache/doris/pull/48665#issuecomment-2699733654 TPC-H: Total hot run time: 40408 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 1d0ff4b31f6c556f2ea9eab5fa7ec0a07ed10f22, data reload: false -- Round 1 -- q1 17588 682372666823 q2 2058169 187 169 q3 10627 106411361064 q4 10556 766 754 754 q5 7768281828832818 q6 225 136 133 133 q7 963 616 619 616 q8 9366195619831956 q9 6679641163986398 q10 7013225823232258 q11 466 258 255 255 q12 407 211 221 211 q13 17778 303230213021 q14 244 200 205 200 q15 512 471 471 471 q16 661 607 588 588 q17 972 604 557 557 q18 7179668467436684 q19 1380100210391002 q20 480 218 200 200 q21 4025327431673167 q22 1139106310751063 Total cold run time: 108086 ms Total hot run time: 40408 ms - Round 2, with runtime_filter_mode=off - q1 6651657966036579 q2 333 233 235 233 q3 2935288630292886 q4 2039182118081808 q5 5858584058255825 q6 211 131 132 131 q7 2288186318701863 q8 3448362235253525 q9 88638895 q10 3564349535023495 q11 581 485 490 485 q12 833 596 631 596 q13 8476317731683168 q14 316 264 292 264 q15 518 472 458 458 q16 689 664 670 664 q17 1852163116161616 q18 8055765478587654 q19 1652153915001500 q20 2050182718801827 q21 5560536053775360 q22 1176106610401040 Total cold run time: 67948 ms Total hot run time: 59865 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](inverted index) Added Error Check for Zero File Read Result [doris]
zzzxl1993 commented on code in PR #48666:
URL: https://github.com/apache/doris/pull/48666#discussion_r1980645090
##
be/src/olap/rowset/segment_v2/inverted_index_fs_directory.cpp:
##
@@ -221,6 +221,13 @@ void DorisFSDirectory::FSIndexInput::readInternal(uint8_t*
b, const int32_t len)
if (!st.ok()) {
_CLTHROWA(CL_ERR_IO, "read past EOF");
}
+if (bytes_read == 0) {
Review Comment:
The test_index_compound_directory_fault_injection test case is already
implemented. The primary fix addresses the core dump problem observed in this
scenario.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](arrow) Fix UT `DataTypeSerDeArrowTest` of Date type (#48398)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new b5955394077 [fix](arrow) Fix UT `DataTypeSerDeArrowTest` of Date type
(#48398)
b5955394077 is described below
commit b5955394077d1b8ad491e3e27c80ebbe00297791
Author: Xinyi Zou
AuthorDate: Wed Mar 5 09:46:14 2025 +0800
[fix](arrow) Fix UT `DataTypeSerDeArrowTest` of Date type (#48398)
### What problem does this PR solve?
1. Fix `TYPE_DATETIME`, `TYPE_DATETIMEV2`, `TYPE_DATE`, `TYPE_DATEV2`
deserialize from Arrow data to Doris data type.
2. Delete unused code.
---
be/src/exec/schema_scanner.h | 3 +-
be/src/runtime/types.cpp | 20 +-
be/src/runtime/types.h | 3 +-
be/src/util/arrow/block_convertor.cpp | 286 +
be/src/util/arrow/row_batch.cpp| 2 -
be/src/vec/data_types/data_type_time_v2.h | 4 +-
.../data_types/serde/data_type_date64_serde.cpp| 33 ++-
.../vec/data_types/serde/data_type_date64_serde.h | 7 +
.../serde/data_type_serde_arrow_test.cpp | 107 +++-
be/test/vec/exec/parquet/parquet_thrift_test.cpp | 4 +-
be/test/vec/exprs/vexpr_test.cpp | 4 +-
11 files changed, 92 insertions(+), 381 deletions(-)
diff --git a/be/src/exec/schema_scanner.h b/be/src/exec/schema_scanner.h
index 6e7a229b7fd..d464df0324d 100644
--- a/be/src/exec/schema_scanner.h
+++ b/be/src/exec/schema_scanner.h
@@ -88,8 +88,9 @@ public:
PrimitiveType type;
int size;
bool is_null;
-/// Only set if type == TYPE_DECIMAL or DATETIMEV2
+/// Only set if type == TYPE_DECIMAL
int precision = -1;
+/// Only set if type == TYPE_DECIMAL or DATETIMEV2
int scale = -1;
};
SchemaScanner(const std::vector& columns,
diff --git a/be/src/runtime/types.cpp b/be/src/runtime/types.cpp
index 7b7154fb38a..f0112ebd2bc 100644
--- a/be/src/runtime/types.cpp
+++ b/be/src/runtime/types.cpp
@@ -46,11 +46,14 @@ TypeDescriptor::TypeDescriptor(const
std::vector& types, int* idx)
DCHECK(scalar_type.__isset.len);
len = scalar_type.len;
} else if (type == TYPE_DECIMALV2 || type == TYPE_DECIMAL32 || type ==
TYPE_DECIMAL64 ||
- type == TYPE_DECIMAL128I || type == TYPE_DECIMAL256 || type
== TYPE_DATETIMEV2) {
+ type == TYPE_DECIMAL128I || type == TYPE_DECIMAL256) {
DCHECK(scalar_type.__isset.precision);
DCHECK(scalar_type.__isset.scale);
precision = scalar_type.precision;
scale = scalar_type.scale;
+} else if (type == TYPE_DATETIMEV2) {
+DCHECK(scalar_type.__isset.scale);
+scale = scalar_type.scale;
} else if (type == TYPE_TIMEV2) {
if (scalar_type.__isset.scale) {
scale = scalar_type.scale;
@@ -157,11 +160,14 @@ void TypeDescriptor::to_thrift(TTypeDesc* thrift_type)
const {
// DCHECK_NE(len, -1);
scalar_type.__set_len(len);
} else if (type == TYPE_DECIMALV2 || type == TYPE_DECIMAL32 || type ==
TYPE_DECIMAL64 ||
- type == TYPE_DECIMAL128I || type == TYPE_DECIMAL256 || type
== TYPE_DATETIMEV2) {
+ type == TYPE_DECIMAL128I || type == TYPE_DECIMAL256) {
DCHECK_NE(precision, -1);
DCHECK_NE(scale, -1);
scalar_type.__set_precision(precision);
scalar_type.__set_scale(scale);
+} else if (type == TYPE_DATETIMEV2) {
+DCHECK_NE(scale, -1);
+scalar_type.__set_scale(scale);
}
}
}
@@ -174,11 +180,14 @@ void TypeDescriptor::to_protobuf(PTypeDesc* ptype) const {
if (type == TYPE_CHAR || type == TYPE_VARCHAR || type == TYPE_HLL || type
== TYPE_STRING) {
scalar_type->set_len(len);
} else if (type == TYPE_DECIMALV2 || type == TYPE_DECIMAL32 || type ==
TYPE_DECIMAL64 ||
- type == TYPE_DECIMAL128I || type == TYPE_DECIMAL256 || type ==
TYPE_DATETIMEV2) {
+ type == TYPE_DECIMAL128I || type == TYPE_DECIMAL256) {
DCHECK_NE(precision, -1);
DCHECK_NE(scale, -1);
scalar_type->set_precision(precision);
scalar_type->set_scale(scale);
+} else if (type == TYPE_DATETIMEV2) {
+DCHECK_NE(scale, -1);
+scalar_type->set_scale(scale);
} else if (type == TYPE_ARRAY) {
node->set_type(TTypeNodeType::ARRAY);
node->set_contains_null(contains_nulls[0]);
@@ -224,11 +233,14 @@ TypeDescriptor::TypeDescriptor(const
google::protobuf::RepeatedPtrField children;
@@ -69,11 +70,11 @@ struct TypeDescriptor {
// explicit TypeDescriptor(PrimitiveType type) :
TypeDescriptor(Prim
(doris) branch branch-2.1 updated: branch-2.1: [fix](heartbeat) avoid failure immediately due to connection reset #48444 (#48635)
This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 0dd5eaf5765 branch-2.1: [fix](heartbeat) avoid failure immediately due
to connection reset #48444 (#48635)
0dd5eaf5765 is described below
commit 0dd5eaf57659d307c7f0a0361fe8b946fc04960e
Author: github-actions[bot]
<41898282+github-actions[bot]@users.noreply.github.com>
AuthorDate: Wed Mar 5 09:52:46 2025 +0800
branch-2.1: [fix](heartbeat) avoid failure immediately due to connection
reset #48444 (#48635)
Cherry-picked from #48444
Co-authored-by: Yongqiang YANG
---
.../src/main/java/org/apache/doris/system/HeartbeatMgr.java | 9 +
1 file changed, 9 insertions(+)
diff --git a/fe/fe-core/src/main/java/org/apache/doris/system/HeartbeatMgr.java
b/fe/fe-core/src/main/java/org/apache/doris/system/HeartbeatMgr.java
index 9a5058f8d02..b42076e0efb 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/system/HeartbeatMgr.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/system/HeartbeatMgr.java
@@ -225,6 +225,15 @@ public class HeartbeatMgr extends MasterDaemon {
@Override
public HeartbeatResponse call() {
+HeartbeatResponse response = pingOnce();
+// We ping twice here to avoid immediately failure due to
connection reset.
+if (response.getStatus() != HbStatus.OK) {
+response = pingOnce();
+}
+return response;
+}
+
+private HeartbeatResponse pingOnce() {
long backendId = backend.getId();
HeartbeatService.Client client = null;
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-2.1: [fix](heartbeat) avoid failure immediately due to connection reset #48444 [doris]
dataroaring merged PR #48635: URL: https://github.com/apache/doris/pull/48635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](nereids) do not fetch partition col stats [doris]
github-actions[bot] commented on PR #48354: URL: https://github.com/apache/doris/pull/48354#issuecomment-2699530664 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-48444-branch-2.1 deleted (was 4896f785248)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-48444-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git was 4896f785248 [fix](heartbeat) avoid failure immediately due to connection reset (#48444) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] branch-3.0: [fix](nereids) fix create/alter view column name force cast to lower case #48569 [doris]
yujun777 commented on PR #48600: URL: https://github.com/apache/doris/pull/48600#issuecomment-2699584511 run performance -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] (test)[auth]Add call auth module case [doris]
zfr9527 closed pull request #44796: (test)[auth]Add call auth module case URL: https://github.com/apache/doris/pull/44796 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](regression)Fix insert p2 cases. [doris]
Jibing-Li commented on PR #48636: URL: https://github.com/apache/doris/pull/48636#issuecomment-2699589024 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] (test)[auth]Add call auth module case [doris]
zfr9527 commented on PR #44796: URL: https://github.com/apache/doris/pull/44796#issuecomment-2699589538 The old PR. Let's meet at #48640 for the new PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-48595-branch-2.1 deleted (was 1c3892641a3)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-48595-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git was 1c3892641a3 [chore](http) add HttpClient::execute debug log (#48595) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](arrow) Fix UT `DataTypeSerDeArrowTest` of Date type [doris]
yiguolei merged PR #48398: URL: https://github.com/apache/doris/pull/48398 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improve](audit) sql that fails to be syntax parsed is not audited [doris]
dqz123 commented on PR #48527: URL: https://github.com/apache/doris/pull/48527#issuecomment-2699503289 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch refactor_rf updated (da8932c743a -> 5ba23190eaa)
This is an automated email from the ASF dual-hosted git repository. gabriellee pushed a change to branch refactor_rf in repository https://gitbox.apache.org/repos/asf/doris.git from da8932c743a test (#48630) add 5ba23190eaa format (#48658) No new revisions were added by this update. Summary of changes: be/test/runtime_filter/runtime_filter_wrapper_test.cpp | 1 - 1 file changed, 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] format [doris]
Gabriel39 opened a new pull request, #48658: URL: https://github.com/apache/doris/pull/48658 ### What problem does this PR solve? Issue Number: close #xxx Related PR: #xxx Problem Summary: ### Release note None ### Check List (For Author) - Test - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason - Behavior changed: - [ ] No. - [ ] Yes. - Does this need documentation? - [ ] No. - [ ] Yes. ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [InvertedIndex](Variant) supoort inverted index for array type in variant [doris]
yiguolei merged PR #48594: URL: https://github.com/apache/doris/pull/48594 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated: branch-2.1-pick: [Opt](partial update) Add some cases for partial update #48161 (#48542)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.1 by this push:
new 4ac431b8c8b branch-2.1-pick: [Opt](partial update) Add some cases for
partial update #48161 (#48542)
4ac431b8c8b is described below
commit 4ac431b8c8b6795eaaa1343c19645475b3b2b353
Author: bobhan1
AuthorDate: Wed Mar 5 10:04:01 2025 +0800
branch-2.1-pick: [Opt](partial update) Add some cases for partial update
#48161 (#48542)
pick https://github.com/apache/doris/pull/48161
---
.../partial_update/test_partial_update.out | Bin 1839 -> 2031 bytes
.../partial_update/test_partial_update_s3_load.out | Bin 0 -> 363 bytes
.../org/apache/doris/regression/suite/Suite.groovy | 19
.../partial_update/test_partial_update.groovy | 80 +++
.../test_partial_update_s3_load.groovy | 110 +
5 files changed, 209 insertions(+)
diff --git
a/regression-test/data/unique_with_mow_p0/partial_update/test_partial_update.out
b/regression-test/data/unique_with_mow_p0/partial_update/test_partial_update.out
index 6c611c00030..e88eb818667 100644
Binary files
a/regression-test/data/unique_with_mow_p0/partial_update/test_partial_update.out
and
b/regression-test/data/unique_with_mow_p0/partial_update/test_partial_update.out
differ
diff --git
a/regression-test/data/unique_with_mow_p0/partial_update/test_partial_update_s3_load.out
b/regression-test/data/unique_with_mow_p0/partial_update/test_partial_update_s3_load.out
new file mode 100644
index 000..f43da803e61
Binary files /dev/null and
b/regression-test/data/unique_with_mow_p0/partial_update/test_partial_update_s3_load.out
differ
diff --git
a/regression-test/framework/src/main/groovy/org/apache/doris/regression/suite/Suite.groovy
b/regression-test/framework/src/main/groovy/org/apache/doris/regression/suite/Suite.groovy
index 1626a6795a8..322b15c70d7 100644
---
a/regression-test/framework/src/main/groovy/org/apache/doris/regression/suite/Suite.groovy
+++
b/regression-test/framework/src/main/groovy/org/apache/doris/regression/suite/Suite.groovy
@@ -732,6 +732,25 @@ class Suite implements GroovyInterceptable {
}
}
+void waitForBrokerLoadDone(String label, int timeoutInSecond = 60) {
+if (timeoutInSecond < 0 || label == null) {
+return
+}
+var start = System.currentTimeMillis()
+var timeout = timeoutInSecond * 1000
+while (System.currentTimeMillis() - start < timeout) {
+def lists = sql "show load where label = '${label}'"
+if (lists.isEmpty()) {
+return
+}
+def state = lists[0][2]
+if ("FINISHED".equals(state) || "CANCELLED".equals(state)) {
+return
+}
+sleep(300)
+}
+logger.warn("broker load with label `${label}` didn't finish in
${timeoutInSecond} second, please check it!")
+}
void expectException(Closure userFunction, String errorMessage = null) {
try {
diff --git
a/regression-test/suites/unique_with_mow_p0/partial_update/test_partial_update.groovy
b/regression-test/suites/unique_with_mow_p0/partial_update/test_partial_update.groovy
index 5e91790baf9..432d57a26ca 100644
---
a/regression-test/suites/unique_with_mow_p0/partial_update/test_partial_update.groovy
+++
b/regression-test/suites/unique_with_mow_p0/partial_update/test_partial_update.groovy
@@ -267,6 +267,86 @@ suite("test_primary_key_partial_update", "p0") {
sql "UPDATE ${tableName} set corp_name = 'B';"
qt_select_update "select corp_name from ${tableName};"
+
+tableName = "test_primary_key_partial_update_1"
+sql """ DROP TABLE IF EXISTS ${tableName} FORCE"""
+sql """ CREATE TABLE IF NOT EXISTS ${tableName} (
+`k1` int NOT NULL,
+`c1` int,
+`c2` int,
+`c3` int,
+`c4` int
+)UNIQUE KEY(k1)
+DISTRIBUTED BY HASH(k1) BUCKETS 1
+PROPERTIES (
+"disable_auto_compaction" = "true",
+"replication_num" = "1"); """
+
+sql "insert into ${tableName} values(1,1,1,1,1);"
+sql "insert into ${tableName} values(2,2,2,2,2);"
+sql "insert into ${tableName} values(3,3,3,3,3);"
+sql "sync;"
+qt_sql "select * from ${tableName} order by k1;"
+
+String content1 =
+"""
+1,99,99,99,99,0
+2,88,88,88,88,0
+4,77,77,77,77,0
+3,23,23,23,23,1
+""".trim()
+streamLoad {
+table "${tableName}"
+set 'column_separator', ','
+set 'format', 'csv'
+set 'partial_columns', 'true'
+
(doris) branch auto-pick-48354-branch-3.0 created (now b1a11192072)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-48354-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git at b1a11192072 branch-3.0: [fix](jdbc catalog) Use factory methods to return mapped types instead 2 #48541 (#48585) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (bb0f5efca8e -> 062301609d9)
This is an automated email from the ASF dual-hosted git repository. englefly pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from bb0f5efca8e [fix](nereids)fix unstable test_correlated_filter_removed case (#48520) add 062301609d9 [fix](regression) topn-filter unstable caseļ¼test_map_select_with_limit (#48598) No new revisions were added by this update. Summary of changes: regression-test/suites/query_p0/limit/test_map_select_with_limit.groovy | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch auto-pick-47509-branch-2.1 deleted (was 45e5dbee4b5)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch auto-pick-47509-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git was 45e5dbee4b5 [improve](load) improve error message "unknown load_id" (#47509) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
