Re: [PR] [fix](workflow) update java version for building broker&extension to jdk17 [doris]
github-actions[bot] commented on PR #32820: URL: https://github.com/apache/doris/pull/32820#issuecomment-2019526813 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](workflow) update java version for building broker&extension to jdk17 [doris]
github-actions[bot] commented on PR #32820: URL: https://github.com/apache/doris/pull/32820#issuecomment-2019526870 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Fix task repeat attach task DCHECK failed [doris]
github-actions[bot] commented on PR #32784: URL: https://github.com/apache/doris/pull/32784#issuecomment-2019527445 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated (a42316f27b1 -> 983e5df8123)
This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a change to branch branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git discard a42316f27b1 [fix](compile) fix code style (#32819) omit a3e7e279f9b Fix compile (#32818) new 983e5df8123 Fix compile (#32818) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (a42316f27b1) \ N -- N -- N refs/heads/branch-2.1 (983e5df8123) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](cloud) add table version to cloud [doris]
github-actions[bot] commented on PR #32738: URL: https://github.com/apache/doris/pull/32738#issuecomment-2019528356 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](runtime filter) Reduce redundant code about PPublishFilterRequestV2 [doris]
BiteThet closed pull request #31936: [Chore](runtime filter) Reduce redundant code about PPublishFilterRequestV2 URL: https://github.com/apache/doris/pull/31936 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) 01/01: Fix compile (#32818)
This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a commit to branch branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git commit 983e5df81239d89388dfc31138687d27dfa2636c Author: zhiqiang AuthorDate: Tue Mar 26 14:18:56 2024 +0800 Fix compile (#32818) [fix](compile) fix code style (#32819) * Fix compile * fix style --- fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java | 2 -- 1 file changed, 2 deletions(-) diff --git a/fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java b/fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java index 3c1467453d7..55e18407254 100644 --- a/fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java +++ b/fe/fe-core/src/main/java/org/apache/doris/qe/ShowExecutor.java @@ -213,9 +213,7 @@ import org.apache.doris.thrift.TNetworkAddress; import org.apache.doris.thrift.TShowProcessListRequest; import org.apache.doris.thrift.TShowProcessListResult; import org.apache.doris.thrift.TTaskType; -import org.apache.doris.thrift.TUnit; import org.apache.doris.transaction.GlobalTransactionMgr; -import org.apache.doris.transaction.GlobalTransactionMgrIface; import org.apache.doris.transaction.TransactionStatus; import com.google.common.base.Preconditions; - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](cast) cast to varchar when comparison predicate input literal and cast to c… [doris]
BiteThet closed pull request #29601: [Bug](cast) cast to varchar when comparison predicate input literal and cast to c… URL: https://github.com/apache/doris/pull/29601 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](join) core caused by null-safe-equal join (#32623) [doris]
mrhhsg opened a new pull request, #32821: URL: https://github.com/apache/doris/pull/32821 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](join) core caused by null-safe-equal join (#32623) [doris]
mrhhsg commented on PR #32821: URL: https://github.com/apache/doris/pull/32821#issuecomment-2019533371 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](join) core caused by null-safe-equal join (#32623) [doris]
doris-robot commented on PR #32821: URL: https://github.com/apache/doris/pull/32821#issuecomment-2019533310 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](workflow) update java version for building broker&extension to jdk17 [doris]
morningman merged PR #32820: URL: https://github.com/apache/doris/pull/32820 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](workflow) update java version for building broker&extension to jdk17 (#32820)
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new 551f66a538f [fix](workflow) update java version for building broker&extension to jdk17 (#32820) 551f66a538f is described below commit 551f66a538f74aed555c964e280127f6c8e6d2d8 Author: Yulei-Yang AuthorDate: Tue Mar 26 15:09:30 2024 +0800 [fix](workflow) update java version for building broker&extension to jdk17 (#32820) --- .github/workflows/build-extension.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.github/workflows/build-extension.yml b/.github/workflows/build-extension.yml index d58e21a75dc..7c7dc5fb8b4 100644 --- a/.github/workflows/build-extension.yml +++ b/.github/workflows/build-extension.yml @@ -61,7 +61,7 @@ jobs: uses: actions/setup-java@v2 with: distribution: adopt - java-version: '8' + java-version: '17' - name: Setup thrift run: | - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](pipeline) fix use error row desc when origin block clear [doris]
Mryange commented on PR #32803: URL: https://github.com/apache/doris/pull/32803#issuecomment-2019537322 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] debug mysqlload [doris]
dataroaring commented on PR #32716: URL: https://github.com/apache/doris/pull/32716#issuecomment-2019537708 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bug](distinct agg) fix distinct streaming agg not output all data [doris]
zhangstar333 commented on PR #32760: URL: https://github.com/apache/doris/pull/32760#issuecomment-2019538742 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[I] [Bug] FE DOCKER 抛出DdlException异常 [doris]
MarkZeng222 opened a new issue, #32822: URL: https://github.com/apache/doris/issues/32822 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version apache/doris:2.0.0_alpha-fe-x86_64 apache/doris:2.0.0_alpha-be-x86_64 ### What's Wrong? 使用docker compose 部署后，FE一直出现org.apache.doris.common.DdlException: errCode = 2, detailMessage = Cluster default_cluster has no available capacity 异常 ### What You Expected? FE正常运行 ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Fix task repeat attach task DCHECK failed [doris]
xinyiZzz commented on PR #32784: URL: https://github.com/apache/doris/pull/32784#issuecomment-2019540381 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [pick-1.2][fix](mysql) fix mysql channel infinite blocking [doris]
github-actions[bot] commented on PR #32741: URL: https://github.com/apache/doris/pull/32741#issuecomment-2019540585 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [pick-1.2][fix](mysql) fix mysql channel infinite blocking [doris]
github-actions[bot] commented on PR #32741: URL: https://github.com/apache/doris/pull/32741#issuecomment-2019540622 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](arrow-flight) Fix arrow flight sql compatible with JDK 11 and upgrade arrow 15.0.2 [doris]
xinyiZzz commented on PR #32796: URL: https://github.com/apache/doris/pull/32796#issuecomment-2019540943 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](hive/iceberg)add doris's version in table properties [doris]
wuwenchi commented on PR #32774: URL: https://github.com/apache/doris/pull/32774#issuecomment-2019540997 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](multicatalog) fix error reading data on tencent ofs after jdk17 [doris]
Yulei-Yang commented on PR #32816: URL: https://github.com/apache/doris/pull/32816#issuecomment-2019541328 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](join) core caused by null-safe-equal join (#32623) [doris]
github-actions[bot] commented on PR #32821: URL: https://github.com/apache/doris/pull/32821#issuecomment-2019541361 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](arrow-flight) BE upgrade arrow to 15.0.2 [doris]
xinyiZzz commented on PR #32805: URL: https://github.com/apache/doris/pull/32805#issuecomment-2019541346 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](insert)fix hive table sink type coercion and unify coercion [doris]
wsjz commented on PR #32762: URL: https://github.com/apache/doris/pull/32762#issuecomment-2019539533 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Bug] FE DOCKER 抛出DdlException异常 [doris]
MarkZeng222 commented on issue #32822:
URL: https://github.com/apache/doris/issues/32822#issuecomment-2019540402
2024-03-26T06:57:12+00:00 [Note] [Entrypoint]: FE_IP_ARRAY = 172.20.10.2
2024-03-26T06:57:12+00:00 [Note] [Entrypoint]: FE_EDIT_LOG_PORT_ARRAY = 9010
2024-03-26T06:57:12+00:00 [Note] [Entrypoint]: MASTER_FE = 172.20.10.2:9010
2024-03-26T06:57:12+00:00 [Note] [Entrypoint]: CURRENT_FE = 172.20.10.2:9010
2024-03-26T06:57:12+00:00 [Note] [Entrypoint]: PRIORITY_NETWORKS =
172.20.10.0/24
2024-03-26T06:57:12+00:00 [Note] [Entrypoint]: Current FE is Master FE! No
need check fe status！
2024-03-26T06:57:12+00:00 [Note] [Entrypoint]: add priority_networks
172.20.10.0/24 to /opt/apache-doris/fe/conf/fe.conf
2024-03-26T06:57:12+00:00 [Note] [Entrypoint]: Current FE is Master FE! No
need to register again！
2024-03-26T06:57:12+00:00 [Note] [Entrypoint]: Current FE is Master FE! No
need check fe status！
2024-03-26T06:57:12+00:00 [Note] [Entrypoint]: Ready to start CURRENT_FE！
=
%d{-MM-dd HH:mm:ss,SSS} %p (%t|%tid) [%C{1}.%M():%L]
%m%n
%d{-MM-dd HH:mm:ss,SSS} %p (%t|%tid) [%C{1}.%M():%L]
%m%n
%d{-MM-dd HH:mm:ss,SSS} %p (%t|%tid) [%C{1}.%M():%L]
%m%n
2024-03-26T06:57:12+00:00 [Warn] [Entrypoint]: FE_SERVERS
fe1:172.20.10.2:9010
2024-03-26T06:57:12+00:00 [Warn] [Entrypoint]: FE_ID 1
%d{-MM-dd HH:mm:ss,SSS} [%c{1}] %m%n
=
==
2024-03-26 06:57:13,809 INFO (main|1) [DorisFE.start():124] Doris FE
starting...
2024-03-26 06:57:13,815 INFO (main|1)
[FrontendOptions.analyzePriorityCidrs():121] configured prior_cidrs value:
172.20.10.0/24
2024-03-26 06:57:13,818 INFO (main|1) [FrontendOptions.init():68] check ip
address: /172.17.0.1
2024-03-26 06:57:13,819 INFO (main|1) [FrontendOptions.init():68] check ip
address: /fe80:0:0:0:f045:17ff:fe67:6071%eth0
2024-03-26 06:57:13,820 INFO (main|1) [FrontendOptions.init():68] check ip
address: /192.168.65.3
2024-03-26 06:57:13,821 INFO (main|1) [FrontendOptions.init():68] check ip
address: /fe80:0:0:0:6862:8eff:fe02:2239%services1
2024-03-26 06:57:13,822 INFO (main|1) [FrontendOptions.init():68] check ip
address: /192.168.65.6
2024-03-26 06:57:13,822 INFO (main|1) [FrontendOptions.init():68] check ip
address: /0:0:0:0:0:0:0:1%lo
2024-03-26 06:57:13,823 INFO (main|1) [FrontendOptions.init():68] check ip
address: /127.0.0.1
2024-03-26 06:57:13,823 INFO (main|1) [FrontendOptions.init():88] local
address: /127.0.0.1.
2024-03-26 06:57:13,928 INFO (main|1)
[ConsistencyChecker.initWorkTime():106] consistency checker will work from
15:00 to 15:00
2024-03-26 06:57:14,402 INFO (main|1) [PrivTable.addEntry():73] add priv
entry: Node_priv Admin_priv
2024-03-26 06:57:14,403 INFO (main|1) [PrivTable.addEntry():73] add priv
entry: Admin_priv
2024-03-26 06:57:14,427 INFO (main|1) [PrivTable.addEntry():73] add priv
entry: database privilege.ctl: internal, db:
default_cluster:information_schema, priv: Select_priv
2024-03-26 06:57:14,428 INFO (main|1) [Auth.createUserInternal():469]
finished to create user: 'root'@'%', is replay: true
2024-03-26 06:57:14,429 INFO (main|1) [PrivTable.addEntry():73] add priv
entry: database privilege.ctl: internal, db:
default_cluster:information_schema, priv: Select_priv
2024-03-26 06:57:14,430 INFO (main|1) [Auth.createUserInternal():469]
finished to create user: 'admin'@'%', is replay: true
2024-03-26 06:57:14,501 INFO (main|1) [Env.getHelperNodes():1231] get helper
nodes: [HostInfo{ip='127.0.0.1', hostName='localhost', port=9010}]
2024-03-26 06:57:14,514 INFO (main|1) [Env.getClusterIdAndRole():944] very
first time to start this node. role: FOLLOWER, node name:
127.0.0.1_9010_1711436234508
2024-03-26 06:57:14,517 INFO (main|1) [Env.getClusterIdAndRole():1099]
finished to get cluster id: 423291160, isElectable: true, role: FOLLOWER and
node name: 127.0.0.1_9010_1711436234508
2024-03-26 06:57:14,524 INFO (main|1) [Env.loadImage():1683] image does not
exist: /opt/apache-doris/fe/doris-meta/image/image.0
2024-03-26 06:57:19,997 WARN (UNKNOWN 127.0.0.1_9010_1711436234508(-1)|1)
[Env.notifyNewFETypeTransfer():2319] notify new FE type transfer: UNKNOWN
[2024-03-26 06:57:19] notify new FE type transfer: UNKNOWN
2024-03-26 06:57
Re: [PR] [fix](pipeline) fix use error row desc when origin block clear [doris]
github-actions[bot] commented on PR #32803: URL: https://github.com/apache/doris/pull/32803#issuecomment-2019543261 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](cooldown) Fix bug in follow cooldowned data [doris]
doris-robot commented on PR #32798: URL: https://github.com/apache/doris/pull/32798#issuecomment-2019543381 TPC-H: Total hot run time: 37748 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 8757cf6ccd10bcae5c995de5805a44fb8178362a, data reload: false -- Round 1 -- q1 17627 416041144114 q2 2111160 151 151 q3 10579 113011711130 q4 10230 754 804 754 q5 7451301529792979 q6 202 130 124 124 q7 1035578 573 573 q8 9338196819691968 q9 7155657565906575 q10 8423345335523453 q11 430 225 215 215 q12 420 197 194 194 q13 17797 284128272827 q14 236 197 209 197 q15 517 457 450 450 q16 492 368 379 368 q17 945 525 620 525 q18 7057644863756375 q19 3364139613891389 q20 563 247 248 247 q21 3516284629342846 q22 343 294 305 294 Total cold run time: 109831 ms Total hot run time: 37748 ms - Round 2, with runtime_filter_mode=off - q1 4143410840664066 q2 328 229 234 229 q3 2959282228032803 q4 1879155715881557 q5 5297534553075307 q6 194 118 120 118 q7 2199185318631853 q8 3138327632403240 q9 8642865686658656 q10 3768376437793764 q11 556 450 447 447 q12 726 537 551 537 q13 16924 288128542854 q14 286 247 250 247 q15 499 460 459 459 q16 473 444 409 409 q17 1710149414561456 q18 7326720570887088 q19 1627152715291527 q20 1902171717501717 q21 4786474845914591 q22 556 470 469 469 Total cold run time: 69918 ms Total hot run time: 53394 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](statistics)Support identical column name in different index. [doris]
Jibing-Li commented on PR #32792: URL: https://github.com/apache/doris/pull/32792#issuecomment-2019544479 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](case) Add basic multi vault case for regression-test and Meta Service's UT [doris]
ByteYue commented on PR #32791: URL: https://github.com/apache/doris/pull/32791#issuecomment-2019545803 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] debug mysqlload [doris]
github-actions[bot] commented on PR #32716: URL: https://github.com/apache/doris/pull/32716#issuecomment-2019545155 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](materialized-view) do not check key/value column when index is dup or mow [doris]
doris-robot commented on PR #32695: URL: https://github.com/apache/doris/pull/32695#issuecomment-2019546135 TeamCity be ut coverage result: Function Coverage: 35.25% (8735/24777) Line Coverage: 27.04% (71530/264524) Region Coverage: 26.28% (37104/141198) Branch Coverage: 23.17% (18971/81876) Coverage Report: http://coverage.selectdb-in.cc/coverage/b78551455a349ccc3c99d8ae0d9b926fd5e6c8a6_b78551455a349ccc3c99d8ae0d9b926fd5e6c8a6/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](memory) Fix task repeat attach task DCHECK failed [doris]
github-actions[bot] commented on PR #32784: URL: https://github.com/apache/doris/pull/32784#issuecomment-2019547089 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](tzdb) update Doris tzfiles to 2024a [doris]
xiaokang merged PR #32705: URL: https://github.com/apache/doris/pull/32705 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.0 updated: [update](tzdb) update Doris tzfiles to 2024a #32648 (#32705)
This is an automated email from the ASF dual-hosted git repository. kxiao pushed a commit to branch branch-2.0 in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/branch-2.0 by this push: new 4b23567d349 [update](tzdb) update Doris tzfiles to 2024a #32648 (#32705) 4b23567d349 is described below commit 4b23567d349a12ebd899d2cadaadb638dbdaa7a9 Author: zclllyybb AuthorDate: Tue Mar 26 15:21:41 2024 +0800 [update](tzdb) update Doris tzfiles to 2024a #32648 (#32705) --- resource/zoneinfo.tar.gz | Bin 671860 -> 134456 bytes 1 file changed, 0 insertions(+), 0 deletions(-) diff --git a/resource/zoneinfo.tar.gz b/resource/zoneinfo.tar.gz index db010ccce99..840cd0a50e5 100644 Binary files a/resource/zoneinfo.tar.gz and b/resource/zoneinfo.tar.gz differ - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Pick "[chore](ColdHeatSeparation) Reduce the frequency of log following read failure #32706" [doris]
xiaokang merged PR #32711: URL: https://github.com/apache/doris/pull/32711 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.0 updated: [chore](ColdHeatSeparation) Reduce the frequency of log following read failure #32706 (#32711)
This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a commit to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.0 by this push:
new b1955a9111a [chore](ColdHeatSeparation) Reduce the frequency of log
following read failure #32706 (#32711)
b1955a9111a is described below
commit b1955a9111a8dba35c9919f7b703e1c384cc4711
Author: AlexYue
AuthorDate: Tue Mar 26 15:22:46 2024 +0800
[chore](ColdHeatSeparation) Reduce the frequency of log following read
failure #32706 (#32711)
---
be/src/olap/olap_server.cpp | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/be/src/olap/olap_server.cpp b/be/src/olap/olap_server.cpp
index e8d735d1873..2a9f911ed96 100644
--- a/be/src/olap/olap_server.cpp
+++ b/be/src/olap/olap_server.cpp
@@ -1206,8 +1206,8 @@ void
StorageEngine::_cold_data_compaction_producer_callback() {
tablet_submitted.erase(t->tablet_id());
}
if (!st.ok()) {
-LOG(WARNING) << "failed to cooldown. tablet_id=" <<
t->tablet_id()
- << " err=" << st;
+LOG_EVERY_N(WARNING, 5)
+<< "failed to cooldown. tablet_id=" <<
t->tablet_id() << " err=" << st;
}
});
}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] Pick "[chore](ColdHeatSeparation) Reduce the frequency of log following read failure #32706" [doris]
xiaokang commented on PR #32711: URL: https://github.com/apache/doris/pull/32711#issuecomment-2019552110 #32706 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](join) core caused by null-safe-equal join (#32623) [doris]
xiaokang commented on PR #32821: URL: https://github.com/apache/doris/pull/32821#issuecomment-2019554710 #32623 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](materialized-view) do not check key/value column when index is dup or mow [doris]
doris-robot commented on PR #32695: URL: https://github.com/apache/doris/pull/32695#issuecomment-2019555876 TPC-H: Total hot run time: 37791 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit b78551455a349ccc3c99d8ae0d9b926fd5e6c8a6, data reload: false -- Round 1 -- q1 17655 419340964096 q2 2102157 164 157 q3 10571 115511881155 q4 10230 727 753 727 q5 7448302129582958 q6 203 123 122 122 q7 1015579 573 573 q8 9345201019761976 q9 7241658065736573 q10 8400347935363479 q11 433 233 218 218 q12 430 197 192 192 q13 17814 287028432843 q14 227 207 216 207 q15 501 467 457 457 q16 494 374 370 370 q17 931 525 606 525 q18 7250639564406395 q19 2719134614001346 q20 548 250 244 244 q21 3528286929922869 q22 342 312 309 309 Total cold run time: 109427 ms Total hot run time: 37791 ms - Round 2, with runtime_filter_mode=off - q1 4136407240904072 q2 320 233 234 233 q3 2942288328822882 q4 1798154615231523 q5 5289529853165298 q6 197 116 116 116 q7 2217188018921880 q8 3146328632603260 q9 8638865386328632 q10 3819379637563756 q11 547 449 443 443 q12 721 587 574 574 q13 16938 285628702856 q14 281 255 256 255 q15 496 455 461 455 q16 470 430 434 430 q17 1738150414611461 q18 7384710970867086 q19 1623157015061506 q20 1909172317291723 q21 4757465346354635 q22 511 454 451 451 Total cold run time: 69877 ms Total hot run time: 53527 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](cooldown) Fix bug in follow cooldowned data [doris]
doris-robot commented on PR #32798: URL: https://github.com/apache/doris/pull/32798#issuecomment-2019557592 TPC-DS: Total hot run time: 181761 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 8757cf6ccd10bcae5c995de5805a44fb8178362a, data reload: false query1 936 360 353 353 query2 6552193318611861 query3 6709214 214 214 query4 31959 21303 21289 21289 query5 4360397 402 397 query6 263 175 176 175 query7 4622306 295 295 query8 228 173 170 170 query9 9508233523252325 query10 574 257 249 249 query11 15285 14202 14204 14202 query12 131 85 89 85 query13 1622411 416 411 query14 10451 799481717994 query15 241 192 194 192 query16 7763264 270 264 query17 1970596 553 553 query18 2004300 277 277 query19 342 155 163 155 query20 103 86 85 85 query21 201 130 130 130 query22 4962485048424842 query23 33697 32690 32788 32690 query24 10828 285728392839 query25 623 381 392 381 query26 1173155 166 155 query27 2548345 365 345 query28 7005189218651865 query29 891 627 637 627 query30 303 155 149 149 query31 984 729 761 729 query32 102 66 58 58 query33 765 267 257 257 query34 1005478 490 478 query35 847 622 607 607 query36 1045896 897 896 query37 113 64 64 64 query38 3589348634853485 query39 1480146814181418 query40 214 120 114 114 query41 50 50 48 48 query42 101 93 95 93 query43 470 439 439 439 query44 1153719 717 717 query45 259 256 266 256 query46 682 691 682 query47 1902183418441834 query48 458 364 368 364 query49 1129357 344 344 query50 755 379 377 377 query51 6668663966806639 query52 106 92 90 90 query53 343 275 279 275 query54 316 230 240 230 query55 89 78 83 78 query56 253 232 228 228 query57 1208114311451143 query58 240 206 213 206 query59 2791268924342434 query60 264 255 254 254 query61 120 131 121 121 query62 678 441 457 441 query63 316 273 276 273 query64 5305407739963996 query65 3057301930233019 query66 880 365 358 358 query67 15451 14634 15153 14634 query68 7337518 514 514 query69 620 381 369 369 query70 1231119511611161 query71 518 267 266 266 query72 6633274225792579 query73 749 314 314 314 query74 6797634763426342 query75 3628217921922179 query76 4974873 890 873 query77 651 295 255 255 query78 11010 10222 10125 10125 query79 11700 528 530 528 query80 1927372 381 372 query81 537 212 207 207 query82 875 86 89 86 query83 216 147 146 146 query84 285 86 81 81 query85 1462332 320 320 query86 441 292 313 292 query87 3810351035623510 query88 5444239824102398 query89 525 366 369 366 query90 1975180 178 178 query91 171 135 140 135 query92 62 51 49 49 query93 7294508 485 485 query94 1240184 185 184 query95 442 344 334 334 query96 613 271 272 271 query97 2686246924882469 query98 231 213 211 211 query99 1226914 933 914 Total cold run time: 310781 ms Total hot run time: 181761 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
[PR] [feature](merge-cloud) Add txn kv stats API [doris]
w41ter opened a new pull request, #32823: URL: https://github.com/apache/doris/pull/32823 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](merge-cloud) Add txn kv stats API [doris]
doris-robot commented on PR #32823: URL: https://github.com/apache/doris/pull/32823#issuecomment-2019561160 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](merge-cloud) Add txn kv stats API [doris]
w41ter commented on PR #32823: URL: https://github.com/apache/doris/pull/32823#issuecomment-2019561273 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](cooldown) Fix bug in follow cooldowned data [doris]
doris-robot commented on PR #32798: URL: https://github.com/apache/doris/pull/32798#issuecomment-2019561404 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 8757cf6ccd10bcae5c995de5805a44fb8178362a with default session variables Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s Insert into select: 21.2 seconds inserted 1000 Rows, about 471K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](multicatalog) fix no data error when read hive table on cosn [doris]
Yulei-Yang commented on PR #32815: URL: https://github.com/apache/doris/pull/32815#issuecomment-2019562610 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](index writer) fix dead lock when closeInternal catches CLuceneError [doris-thirdparty]
qidaye merged PR #207: URL: https://github.com/apache/doris-thirdparty/pull/207 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris-thirdparty) branch clucene updated: [Fix](index writer) fix dead lock when closeInternal catches CLuceneError (#207)
This is an automated email from the ASF dual-hosted git repository.
jianliangqi pushed a commit to branch clucene
in repository https://gitbox.apache.org/repos/asf/doris-thirdparty.git
The following commit(s) were added to refs/heads/clucene by this push:
new 70d7a7b68b [Fix](index writer) fix dead lock when closeInternal
catches CLuceneError (#207)
70d7a7b68b is described below
commit 70d7a7b68b40ebbc269aa9e8b799fadf19807c4f
Author: airborne12
AuthorDate: Tue Mar 26 15:31:46 2024 +0800
[Fix](index writer) fix dead lock when closeInternal catches CLuceneError
(#207)
This pull request addresses an issue within the closeInternal method.
When Thread A invokes closeInternal and encounters a CLucene error, the
method exits without setting the closing flag back to false.
As a result, if another Thread B subsequently calls closeInternal and
enters the waitForClose method, it becomes trapped in an infinite loop.
---
src/core/CLucene/index/IndexWriter.cpp | 2 --
1 file changed, 2 deletions(-)
diff --git a/src/core/CLucene/index/IndexWriter.cpp
b/src/core/CLucene/index/IndexWriter.cpp
index 0d770182ba..e6a0887557 100644
--- a/src/core/CLucene/index/IndexWriter.cpp
+++ b/src/core/CLucene/index/IndexWriter.cpp
@@ -596,8 +596,6 @@ void IndexWriter::closeInternal(bool waitForMerges) {
} catch (std::bad_alloc &) {
hitOOM = true;
_CLTHROWA(CL_ERR_OutOfMemory, "Out of memory");
-} catch (CLuceneError &e) {
-throw e;
}
_CLFINALLY(
{
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](join) core caused by null-safe-equal join (#32623) [doris]
doris-robot commented on PR #32821: URL: https://github.com/apache/doris/pull/32821#issuecomment-2019563189 TeamCity be ut coverage result: Function Coverage: 37.80% (8046/21285) Line Coverage: 29.47% (65716/223012) Region Coverage: 28.93% (33814/116899) Branch Coverage: 24.78% (17359/70064) Coverage Report: http://coverage.selectdb-in.cc/coverage/6c3822fc0ec51d01675d0ce991711a60a0a69077_6c3822fc0ec51d01675d0ce991711a60a0a69077/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](Nereids) Nereids supports group_commit with insert [doris]
doris-robot commented on PR #32523: URL: https://github.com/apache/doris/pull/32523#issuecomment-2019567341 TPC-H: Total hot run time: 37960 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit d4454418265c372ccdbcf50b46ef5454dfbc1226, data reload: false -- Round 1 -- q1 17668 422841204120 q2 2128152 154 152 q3 10578 108911831089 q4 10232 755 741 741 q5 7469301629742974 q6 204 124 123 123 q7 1018577 578 577 q8 9338196919451945 q9 7262662766026602 q10 8402347135843471 q11 436 228 221 221 q12 405 201 193 193 q13 20455 289329312893 q14 243 212 202 202 q15 506 461 456 456 q16 492 372 370 370 q17 934 548 583 548 q18 7059647364156415 q19 1580144914451445 q20 549 264 252 252 q21 3558290028562856 q22 364 315 319 315 Total cold run time: 110880 ms Total hot run time: 37960 ms - Round 2, with runtime_filter_mode=off - q1 4300425141384138 q2 339 245 249 245 q3 3095302130093009 q4 1918161916521619 q5 5508546954205420 q6 194 117 118 117 q7 2242186718941867 q8 3221335332833283 q9 8704863286208620 q10 3763376437083708 q11 544 434 444 434 q12 701 532 550 532 q13 16919 286628622862 q14 283 250 250 250 q15 511 458 462 458 q16 458 436 420 420 q17 1744148814761476 q18 7537711071047104 q19 8628150615101506 q20 1944172117081708 q21 4762464146764641 q22 527 468 469 468 Total cold run time: 77842 ms Total hot run time: 53885 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](merge-cloud) Add txn kv stats API [doris]
github-actions[bot] commented on code in PR #32823: URL: https://github.com/apache/doris/pull/32823#discussion_r1538709320 ## cloud/src/meta-service/txn_kv.h: ## @@ -20,7 +20,6 @@ #include Review Comment: warning: 'foundationdb/fdb_c.h' file not found [clang-diagnostic-error] ```cpp #include ^ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](materialized-view) do not check key/value column when index is dup or mow [doris]
doris-robot commented on PR #32695: URL: https://github.com/apache/doris/pull/32695#issuecomment-2019570399 TPC-DS: Total hot run time: 181836 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit b78551455a349ccc3c99d8ae0d9b926fd5e6c8a6, data reload: false query1 948 368 347 347 query2 6562193419041904 query3 6702216 209 209 query4 31817 21249 21281 21249 query5 4300399 392 392 query6 268 170 175 170 query7 4628284 283 283 query8 221 172 169 169 query9 9340233523332333 query10 584 250 279 250 query11 17302 14310 14237 14237 query12 135 96 88 88 query13 1644428 417 417 query14 10009 737573287328 query15 233 198 192 192 query16 8149249 257 249 query17 1970579 529 529 query18 2078274 270 270 query19 264 159 150 150 query20 94 88 88 88 query21 198 130 129 129 query22 5164502149064906 query23 33660 33015 33085 33015 query24 10707 290328292829 query25 618 384 381 381 query26 1179161 165 161 query27 3346357 361 357 query28 7584189218771877 query29 891 659 631 631 query30 304 148 153 148 query31 991 756 737 737 query32 92 55 56 55 query33 774 275 254 254 query34 1024480 483 480 query35 832 607 614 607 query36 1016873 864 864 query37 112 66 63 63 query38 3609348133953395 query39 1478142614171417 query40 203 116 113 113 query41 52 47 48 47 query42 104 96 98 96 query43 483 440 445 440 query44 1223731 709 709 query45 275 268 268 268 query46 1116690 699 690 query47 1962184918471847 query48 434 365 364 364 query49 1138347 339 339 query50 760 374 376 374 query51 6943687167396739 query52 104 90 88 88 query53 338 273 273 273 query54 299 245 241 241 query55 100 79 77 77 query56 246 232 229 229 query57 1217113611561136 query58 236 212 216 212 query59 2781246825882468 query60 279 244 258 244 query61 115 112 110 110 query62 680 444 470 444 query63 317 282 270 270 query64 5540413439733973 query65 3052302030423020 query66 887 376 386 376 query67 15256 15172 14845 14845 query68 5676522 512 512 query69 605 378 378 378 query70 1188118011791179 query71 437 253 262 253 query72 6609271525542554 query73 693 319 317 317 query74 7991653064886488 query75 3063221621672167 query76 3962876 905 876 query77 619 250 250 250 query78 10976 10265 10198 10198 query79 8699518 514 514 query80 1983370 365 365 query81 538 208 216 208 query82 103189 88 88 query83 340 142 144 142 query84 285 87 77 77 query85 2054324 311 311 query86 499 286 293 286 query87 3755359135983591 query88 5130235923612359 query89 526 353 370 353 query90 1992173 175 173 query91 168 132 135 132 query92 64 52 47 47 query93 7137501 485 485 query94 1194180 179 179 query95 439 336 334 334 query96 612 273 279 273 query97 2664246224782462 query98 232 221 200 200 query99 1219893 924 893 Total cold run time: 309347 ms Total hot run time: 181836 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
Re: [PR] [bug](distinct agg) fix distinct streaming agg not output all data [doris]
doris-robot commented on PR #32760: URL: https://github.com/apache/doris/pull/32760#issuecomment-2019572867 TeamCity be ut coverage result: Function Coverage: 35.27% (8738/24777) Line Coverage: 27.05% (71557/264523) Region Coverage: 26.29% (37123/141202) Branch Coverage: 23.19% (18986/81882) Coverage Report: http://coverage.selectdb-in.cc/coverage/ee5fa0efd1d448919702406b26d53eca4c351cd2_ee5fa0efd1d448919702406b26d53eca4c351cd2/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](pipeline) fix use error row desc when origin block clear [doris]
doris-robot commented on PR #32803: URL: https://github.com/apache/doris/pull/32803#issuecomment-2019573686 TeamCity be ut coverage result: Function Coverage: 35.27% (8738/24777) Line Coverage: 27.05% (71555/264515) Region Coverage: 26.29% (37115/141193) Branch Coverage: 23.18% (18979/81874) Coverage Report: http://coverage.selectdb-in.cc/coverage/ee26304ef83b2a66471f01d77f871dbb2c10264f_ee26304ef83b2a66471f01d77f871dbb2c10264f/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] debug mysqlload [doris]
doris-robot commented on PR #32716: URL: https://github.com/apache/doris/pull/32716#issuecomment-2019572843 TeamCity be ut coverage result: Function Coverage: 35.27% (8738/24777) Line Coverage: 27.05% (71552/264543) Region Coverage: 26.29% (37121/141200) Branch Coverage: 23.18% (18977/81880) Coverage Report: http://coverage.selectdb-in.cc/coverage/6442a3524cb0a2b2f787644a304c5cedef984caf_6442a3524cb0a2b2f787644a304c5cedef984caf/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Bug](materialized-view) do not check key/value column when index is dup or mow [doris]
doris-robot commented on PR #32695: URL: https://github.com/apache/doris/pull/32695#issuecomment-2019574308 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit b78551455a349ccc3c99d8ae0d9b926fd5e6c8a6 with default session variables Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.9 seconds inserted 1000 Rows, about 456K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](join) core caused by null-safe-equal join (#32623) [doris]
doris-robot commented on PR #32821: URL: https://github.com/apache/doris/pull/32821#issuecomment-2019576873 TPC-H: Total hot run time: 49982 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 6c3822fc0ec51d01675d0ce991711a60a0a69077, data reload: false -- Round 1 -- q1 17614 436243494349 q2 2125151 143 143 q3 10653 187319311873 q4 10378 123714551237 q5 8379392739653927 q6 235 125 124 124 q7 2019160015991599 q8 9281269727042697 q9 10749 10559 10532 10532 q10 8880355235893552 q11 423 245 244 244 q12 465 310 306 306 q13 18853 391640143916 q14 349 315 329 315 q15 510 464 455 455 q16 690 590 580 580 q17 1129957 957 957 q18 7258689669406896 q19 1662156915271527 q20 538 290 307 290 q21 4413406340734063 q22 498 408 400 400 Total cold run time: 117101 ms Total hot run time: 49982 ms - Round 2, with runtime_filter_mode=off - q1 4334431343024302 q2 318 228 223 223 q3 4113415241704152 q4 2755273927512739 q5 7264719671717171 q6 232 119 117 117 q7 3231281328192813 q8 4378442944624429 q9 17061 16818 16820 16818 q10 4205427642174217 q11 812 675 707 675 q12 1006833 836 833 q13 7065375237083708 q14 454 433 420 420 q15 511 444 442 442 q16 767 695 716 695 q17 3866389938453845 q18 8759887287288728 q19 1703169916611661 q20 2381216021212121 q21 8522844985068449 q22 10411017954 954 Total cold run time: 84778 ms Total hot run time: 79512 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Serde](Variant) support arrow serialization for varint type [doris]
eldenmoon commented on PR #32780: URL: https://github.com/apache/doris/pull/32780#issuecomment-2019576978 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](arrow-flight) BE upgrade arrow to 15.0.2 [doris]
doris-robot commented on PR #32805: URL: https://github.com/apache/doris/pull/32805#issuecomment-2019596620 TeamCity be ut coverage result: Function Coverage: 35.26% (8736/24777) Line Coverage: 27.04% (71534/264518) Region Coverage: 26.28% (37112/141193) Branch Coverage: 23.17% (18973/81874) Coverage Report: http://coverage.selectdb-in.cc/coverage/bb300df7ec9b8edc2c41528c7daf1b86c3bf267d_bb300df7ec9b8edc2c41528c7daf1b86c3bf267d/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](insert)fix hive table sink type coercion and unify coercion [doris]
doris-robot commented on PR #32762: URL: https://github.com/apache/doris/pull/32762#issuecomment-2019608015 TPC-H: Total hot run time: 37704 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 03c11715c0f4150e2181e1f97d7da191e7dd5a74, data reload: false -- Round 1 -- q1 17617 420940674067 q2 2102168 148 148 q3 10573 111211791112 q4 10229 775 783 775 q5 7469296729762967 q6 202 127 124 124 q7 1024586 580 580 q8 9337199019751975 q9 7162656965676567 q10 8426344335663443 q11 435 228 222 222 q12 439 201 205 201 q13 17787 285028912850 q14 242 196 212 196 q15 500 469 450 450 q16 494 375 367 367 q17 947 611 518 518 q18 7083645364216421 q19 1564136414621364 q20 554 254 249 249 q21 3568291928092809 q22 347 299 306 299 Total cold run time: 108101 ms Total hot run time: 37704 ms - Round 2, with runtime_filter_mode=off - q1 4040404440454044 q2 332 234 236 234 q3 2948283328172817 q4 1807156615731566 q5 5308530452995299 q6 194 115 119 115 q7 2258184718631847 q8 3140329032773277 q9 8696869086648664 q10 3788376537263726 q11 546 451 448 448 q12 715 544 563 544 q13 16920 283328412833 q14 282 256 259 256 q15 485 458 475 458 q16 469 451 416 416 q17 1710149414531453 q18 7504727270857085 q19 1618147415321474 q20 1906171816811681 q21 4663483745794579 q22 546 457 458 457 Total cold run time: 69875 ms Total hot run time: 53273 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [enhancement](cloud) add table version to cloud [doris]
doris-robot commented on PR #32738: URL: https://github.com/apache/doris/pull/32738#issuecomment-2019608717 TPC-H: Total hot run time: 37923 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 8a3ea4470aa9b2b057881af6c86095772911608c, data reload: false -- Round 1 -- q1 17683 417140804080 q2 2107164 161 161 q3 10585 111012271110 q4 10231 760 804 760 q5 7482299529852985 q6 201 124 122 122 q7 1049597 579 579 q8 9340199819931993 q9 7060658865746574 q10 8442344935693449 q11 423 223 220 220 q12 432 201 195 195 q13 17795 287128532853 q14 225 204 214 204 q15 513 462 466 462 q16 487 373 370 370 q17 945 540 605 540 q18 7053646064126412 q19 3600147014891470 q20 541 259 273 259 q21 3622294928182818 q22 351 313 307 307 Total cold run time: 110167 ms Total hot run time: 37923 ms - Round 2, with runtime_filter_mode=off - q1 4147410240814081 q2 327 234 237 234 q3 2963287928432843 q4 1824153215251525 q5 5307534553255325 q6 192 113 114 113 q7 2223184218601842 q8 3152326032513251 q9 8663868986528652 q10 3803377437673767 q11 537 447 440 440 q12 712 533 544 533 q13 16912 281028402810 q14 278 249 267 249 q15 499 464 452 452 q16 490 424 417 417 q17 1740149814671467 q18 7338722770407040 q19 2130154115201520 q20 1900173317271727 q21 4866465946624659 q22 515 475 459 459 Total cold run time: 70518 ms Total hot run time: 53406 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bug](distinct agg) fix distinct streaming agg not output all data [doris]
doris-robot commented on PR #32760: URL: https://github.com/apache/doris/pull/32760#issuecomment-2019614999 TPC-H: Total hot run time: 37596 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ee5fa0efd1d448919702406b26d53eca4c351cd2, data reload: false -- Round 1 -- q1 17655 414840524052 q2 2120151 149 149 q3 10598 114311831143 q4 10219 724 735 724 q5 7474297729352935 q6 201 122 123 122 q7 1018584 580 580 q8 9349198619731973 q9 7153657765276527 q10 8410338235463382 q11 438 234 220 220 q12 438 203 208 203 q13 17806 284228672842 q14 230 208 202 202 q15 518 457 462 457 q16 480 372 370 370 q17 940 504 551 504 q18 7043653764046404 q19 2954144314781443 q20 529 298 248 248 q21 3648299028302830 q22 341 290 286 286 Total cold run time: 109562 ms Total hot run time: 37596 ms - Round 2, with runtime_filter_mode=off - q1 4082402240834022 q2 324 232 230 230 q3 2949290428322832 q4 1840158215801580 q5 5307534553215321 q6 195 116 119 116 q7 2244184418391839 q8 3140326432723264 q9 8680867686608660 q10 3787371137433711 q11 538 449 441 441 q12 710 546 554 546 q13 16943 286528852865 q14 290 267 255 255 q15 500 464 461 461 q16 475 420 416 416 q17 1711148014741474 q18 7426731170357035 q19 1602148714481448 q20 1929174117101710 q21 4907494146424642 q22 538 436 446 436 Total cold run time: 70117 ms Total hot run time: 53304 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](case) Add basic multi vault case for regression-test and Meta Service's UT [doris]
doris-robot commented on PR #32791: URL: https://github.com/apache/doris/pull/32791#issuecomment-2019624610 TeamCity be ut coverage result: Function Coverage: 35.27% (8738/24777) Line Coverage: 27.05% (71550/264518) Region Coverage: 26.29% (37120/141193) Branch Coverage: 23.18% (18978/81874) Coverage Report: http://coverage.selectdb-in.cc/coverage/163dda6baeea8db807b0688afae44e6af448b674_163dda6baeea8db807b0688afae44e6af448b674/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) 06/06: [feature](Nereids) support data masking policy (#32526)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
commit f9ae03ac3c766dd3ee0e831af65cb20af1ff911e
Author: 924060929 <924060...@qq.com>
AuthorDate: Fri Mar 22 10:58:43 2024 +0800
[feature](Nereids) support data masking policy (#32526)
support data masking policy
note:
if a user send the query
```sql
select name from tbl limit 1
```
and the user have row policy on `tbl.name` with the filter `name =
'Beijing'`, and have data masking policy on `tbl.name` with the masking
`concat(substring(name, 1, 4), '')`, we will rewrite the query to
```sql
select concat(substring(name, 1, 4), '') as name
from tbl
where name = 'Beijing' -- note that this name is from tbl, not from the
alias in the select list
limit 1
```
the result would be `Beij`
---
.../doris/nereids/rules/analysis/CheckPolicy.java | 24 +--
.../trees/plans/logical/LogicalCheckPolicy.java| 67 +--
.../java/org/apache/doris/policy/PolicyMgr.java| 6 +-
.../nereids/privileges/TestCheckPrivileges.java| 200 -
4 files changed, 270 insertions(+), 27 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/CheckPolicy.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/CheckPolicy.java
index aa2917ae1e1..1e7d4dbb09d 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/CheckPolicy.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/CheckPolicy.java
@@ -24,14 +24,16 @@ import org.apache.doris.nereids.rules.RuleType;
import org.apache.doris.nereids.trees.expressions.Expression;
import org.apache.doris.nereids.trees.plans.Plan;
import org.apache.doris.nereids.trees.plans.logical.LogicalCheckPolicy;
+import
org.apache.doris.nereids.trees.plans.logical.LogicalCheckPolicy.RelatedPolicy;
import org.apache.doris.nereids.trees.plans.logical.LogicalFileScan;
import org.apache.doris.nereids.trees.plans.logical.LogicalFilter;
+import org.apache.doris.nereids.trees.plans.logical.LogicalProject;
import org.apache.doris.nereids.trees.plans.logical.LogicalRelation;
import org.apache.doris.nereids.util.ExpressionUtils;
import com.google.common.collect.ImmutableList;
-import java.util.HashSet;
+import java.util.LinkedHashSet;
import java.util.List;
import java.util.Set;
@@ -60,7 +62,7 @@ public class CheckPolicy implements AnalysisRuleFactory {
return ctx.root.child();
}
LogicalRelation relation = (LogicalRelation) child;
-Set combineFilter = new HashSet<>();
+Set combineFilter = new
LinkedHashSet<>();
// replace incremental params as AND expression
if (relation instanceof LogicalFileScan) {
@@ -72,18 +74,20 @@ public class CheckPolicy implements AnalysisRuleFactory {
}
}
-// row policy
-checkPolicy.getFilter(relation, ctx.connectContext)
-.ifPresent(expression ->
combineFilter.addAll(
+RelatedPolicy relatedPolicy =
checkPolicy.findPolicy(relation, ctx.cascadesContext);
+relatedPolicy.rowPolicyFilter.ifPresent(expression
-> combineFilter.addAll(
ExpressionUtils.extractConjunctionToSet(expression)));
-
-if (combineFilter.isEmpty()) {
-return ctx.root.child();
-}
+Plan result = relation;
if (upperFilter != null) {
combineFilter.addAll(upperFilter.getConjuncts());
}
-return new LogicalFilter<>(combineFilter,
relation);
+if (!combineFilter.isEmpty()) {
+result = new LogicalFilter<>(combineFilter,
relation);
+}
+if (relatedPolicy.dataMaskProjects.isPresent()) {
+result = new
LogicalProject<>(relatedPolicy.dataMaskProjects.get(), result);
+}
+return result;
})
)
);
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/logical/LogicalCheckPolicy.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/logical/LogicalCheckPolicy.java
index 54f38034761..bda3b1f49d5 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/tr
(doris) 05/06: [enhance](auth)row policy support catalog and match name instead id (#32310)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 0a2d7379fcf86c7ea7aab628c34517d01e8db74e
Author: zhangdong <493738...@qq.com>
AuthorDate: Mon Mar 18 14:59:03 2024 +0800
[enhance](auth)row policy support catalog and match name instead id (#32310)
Follow up #32137
storage name instead id to meta,Prevent table deletion and reconstruction
and causing ID changes
---
.../org/apache/doris/analysis/StmtRewriter.java| 15 ++-
.../mysql/privilege/AccessControllerManager.java | 3 +-
.../mysql/privilege/CatalogAccessController.java | 4 +-
.../mysql/privilege/InternalAccessController.java | 19 +---
.../trees/plans/logical/LogicalCheckPolicy.java| 9 +-
.../org/apache/doris/policy/DropPolicyLog.java | 42 +--
.../main/java/org/apache/doris/policy/Policy.java | 11 +-
.../java/org/apache/doris/policy/PolicyMgr.java| 126 +
.../java/org/apache/doris/policy/RowPolicy.java| 44 +--
.../apache/doris/datasource/ColumnPrivTest.java| 3 +-
.../nereids/privileges/TestCheckPrivileges.java| 2 +-
11 files changed, 183 insertions(+), 95 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/analysis/StmtRewriter.java
b/fe/fe-core/src/main/java/org/apache/doris/analysis/StmtRewriter.java
index 0c6c71b7c2f..62737131b62 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/analysis/StmtRewriter.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/analysis/StmtRewriter.java
@@ -21,10 +21,8 @@
package org.apache.doris.analysis;
import org.apache.doris.catalog.Column;
-import org.apache.doris.catalog.DatabaseIf;
import org.apache.doris.catalog.Env;
import org.apache.doris.catalog.ScalarType;
-import org.apache.doris.catalog.TableIf;
import org.apache.doris.catalog.Type;
import org.apache.doris.common.AnalysisException;
import org.apache.doris.common.TableAliasGenerator;
@@ -1327,16 +1325,17 @@ public class StmtRewriter {
if (!(tableRef instanceof BaseTableRef)) {
continue;
}
-TableIf table = tableRef.getTable();
+String tableName = tableRef.getName().getTbl();
String dbName = tableRef.getName().getDb();
if (dbName == null) {
dbName = analyzer.getDefaultDb();
}
-DatabaseIf db =
currentEnv.getCatalogMgr().getCatalogOrAnalysisException(tableRef.getName().getCtl())
-.getDbOrAnalysisException(dbName);
-long dbId = db.getId();
-long tableId = table.getId();
-RowPolicy matchPolicy =
currentEnv.getPolicyMgr().getMatchTablePolicy(dbId, tableId,
currentUserIdentity);
+String ctlName = tableRef.getName().getCtl();
+if (ctlName == null) {
+ctlName = analyzer.getDefaultCatalog();
+}
+RowPolicy matchPolicy = currentEnv.getPolicyMgr()
+.getMatchTablePolicy(ctlName, dbName, tableName,
currentUserIdentity);
if (matchPolicy == null) {
continue;
}
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/AccessControllerManager.java
b/fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/AccessControllerManager.java
index 85392695237..3a264d6d217 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/AccessControllerManager.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/AccessControllerManager.java
@@ -22,7 +22,6 @@ import org.apache.doris.analysis.UserIdentity;
import org.apache.doris.catalog.AuthorizationInfo;
import org.apache.doris.catalog.Env;
import
org.apache.doris.catalog.authorizer.ranger.doris.RangerDorisAccessController;
-import org.apache.doris.common.AnalysisException;
import org.apache.doris.common.Config;
import org.apache.doris.common.UserException;
import org.apache.doris.datasource.CatalogIf;
@@ -273,7 +272,7 @@ public class AccessControllerManager {
}
public List evalRowFilterPolicies(UserIdentity
currentUser, String
-ctl, String db, String tbl) throws AnalysisException {
+ctl, String db, String tbl) {
Objects.requireNonNull(currentUser, "require currentUser object");
Objects.requireNonNull(ctl, "require ctl object");
Objects.requireNonNull(db, "require db object");
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/CatalogAccessController.java
b/fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/CatalogAccessController.java
index aa51856231c..65906b700c3 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/CatalogAccessController.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/CatalogAccessController.java
@@ -18,7 +18,6 @@
package org.apache.doris.mysql.privi
(doris) 03/06: [feature-wip](ranger)support datamask and row filter (#32137)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 37c8cc040d6581243acb0ff064ccf9f4c382ec4c
Author: zhangdong <493738...@qq.com>
AuthorDate: Mon Mar 18 11:59:35 2024 +0800
[feature-wip](ranger)support datamask and row filter (#32137)
doris ranger support datamask and row filter
hive ranger support row filter
---
.../authorizer/ranger/RangerAccessController.java | 78
.../ranger/doris/RangerDorisAccessController.java | 56 ++-
.../ranger/hive/RangerHiveAccessController.java| 73 +--
.../mysql/privilege/AccessControllerManager.java | 32 +++
.../mysql/privilege/CatalogAccessController.java | 9 ++
.../doris/mysql/privilege/DataMaskPolicy.java | 24 +
.../mysql/privilege/InternalAccessController.java | 30 ++
.../mysql/privilege/RangerDataMaskPolicy.java | 103 +
.../mysql/privilege/RangerRowFilterPolicy.java | 95 +++
.../doris/mysql/privilege/RowFilterPolicy.java | 32 +++
.../trees/plans/logical/LogicalCheckPolicy.java| 40
.../java/org/apache/doris/policy/RowPolicy.java| 25 -
.../java/org/apache/doris/qe/ConnectContext.java | 82
.../apache/doris/datasource/ColumnPrivTest.java| 16
.../nereids/privileges/TestCheckPrivileges.java| 15 +++
15 files changed, 556 insertions(+), 154 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/RangerAccessController.java
b/fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/RangerAccessController.java
index 30b42e19976..5f49f4d5735 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/RangerAccessController.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/catalog/authorizer/ranger/RangerAccessController.java
@@ -17,15 +17,27 @@
package org.apache.doris.catalog.authorizer.ranger;
+import org.apache.doris.analysis.UserIdentity;
import org.apache.doris.common.AuthorizationException;
import org.apache.doris.mysql.privilege.CatalogAccessController;
+import org.apache.doris.mysql.privilege.DataMaskPolicy;
+import org.apache.doris.mysql.privilege.RangerDataMaskPolicy;
+import org.apache.doris.mysql.privilege.RangerRowFilterPolicy;
+import org.apache.doris.mysql.privilege.RowFilterPolicy;
+import com.google.common.collect.Lists;
+import org.apache.commons.lang3.StringUtils;
import org.apache.logging.log4j.LogManager;
import org.apache.logging.log4j.Logger;
import org.apache.ranger.plugin.policyengine.RangerAccessRequestImpl;
+import org.apache.ranger.plugin.policyengine.RangerAccessResourceImpl;
import org.apache.ranger.plugin.policyengine.RangerAccessResult;
+import org.apache.ranger.plugin.policyengine.RangerAccessResultProcessor;
+import org.apache.ranger.plugin.service.RangerBasePlugin;
import java.util.Collection;
+import java.util.List;
+import java.util.Optional;
public abstract class RangerAccessController implements
CatalogAccessController {
private static final Logger LOG =
LogManager.getLogger(RangerAccessController.class);
@@ -74,4 +86,70 @@ public abstract class RangerAccessController implements
CatalogAccessController
}
}
}
+
+@Override
+public List evalRowFilterPolicies(UserIdentity
currentUser, String ctl, String db,
+String tbl) {
+RangerAccessResourceImpl resource = createResource(ctl, db, tbl);
+RangerAccessRequestImpl request = createRequest(currentUser);
+request.setResource(resource);
+
+if (LOG.isDebugEnabled()) {
+LOG.debug("ranger request: {}", request);
+}
+List res = Lists.newArrayList();
+RangerAccessResult policy = getPlugin().evalRowFilterPolicies(request,
getAccessResultProcessor());
+if (LOG.isDebugEnabled()) {
+LOG.debug("ranger response: {}", policy);
+}
+if (policy == null) {
+return res;
+}
+String filterExpr = policy.getFilterExpr();
+if (StringUtils.isEmpty(filterExpr)) {
+return res;
+}
+res.add(new RangerRowFilterPolicy(currentUser, ctl, db, tbl,
policy.getPolicyId(), policy.getPolicyVersion(),
+filterExpr));
+return res;
+}
+
+@Override
+public Optional evalDataMaskPolicy(UserIdentity
currentUser, String ctl, String db, String tbl,
+String col) {
+RangerAccessResourceImpl resource = createResource(ctl, db, tbl, col);
+RangerAccessRequestImpl request = createRequest(currentUser);
+request.setResource(resource);
+
+if (LOG.isDebugEnabled()) {
+LOG.debug("ranger request: {}", request);
+}
+RangerAccessResult policy = getPlugin().evalDataMaskPolicies(request,
ge
(doris) 02/06: [feature](hudi) support hudi incremental read (#32052)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
commit ec43f65235a7b247302f3a2ce959b68a48b1ec7f
Author: Ashin Gau
AuthorDate: Thu Mar 14 18:30:18 2024 +0800
[feature](hudi) support hudi incremental read (#32052)
* [feature](hudi) support incremental read for hudi table
* fix jdk17 java options
---
conf/be.conf | 2 +-
docs/en/docs/lakehouse/multi-catalog/hudi.md | 33 ++-
docs/zh-CN/docs/lakehouse/multi-catalog/hudi.md| 37 ++-
.../java/org/apache/doris/hudi/HudiJniScanner.java | 12 +-
.../org/apache/doris/hudi/BaseSplitReader.scala| 8 +-
.../apache/doris/hudi/HoodieRecordIterator.scala | 67 --
.../doris/hudi/MORIncrementalSplitReader.scala | 86 +++
.../apache/doris/hudi/MORSnapshotSplitReader.scala | 2 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 6 +-
fe/fe-core/src/main/cup/sql_parser.cup | 16 +-
.../java/org/apache/doris/analysis/TableRef.java | 14 ++
.../org/apache/doris/analysis/TableScanParams.java | 46
.../doris/datasource/hive/HMSExternalTable.java| 100 +++-
.../hudi/source/COWIncrementalRelation.java| 254 +
.../doris/datasource/hudi/source/HudiScanNode.java | 175 +-
.../hudi/source/IncrementalRelation.java | 44
.../hudi/source/MORIncrementalRelation.java| 217 ++
.../doris/nereids/analyzer/UnboundRelation.java| 34 ++-
.../doris/nereids/parser/LogicalPlanBuilder.java | 9 +-
.../doris/nereids/rules/analysis/BindRelation.java | 8 +-
.../doris/nereids/rules/analysis/CheckPolicy.java | 25 +-
.../data/external_table_p2/hive/test_hive_hudi.out | 12 +
.../external_table_p2/hive/test_hive_hudi.groovy | 6 +
23 files changed, 1095 insertions(+), 118 deletions(-)
diff --git a/conf/be.conf b/conf/be.conf
index 6ceec00a421..4d8677aece7 100644
--- a/conf/be.conf
+++ b/conf/be.conf
@@ -95,4 +95,4 @@ ssl_private_key_path = "$DORIS_HOME/conf/key.pem"
# Default to turn off aws sdk log, because aws sdk errors that need to be
cared will be output through Doris logs
aws_log_level=0
## If you are not running in aws cloud, you can disable EC2 metadata
-AWS_EC2_METADATA_DISABLED=true
\ No newline at end of file
+AWS_EC2_METADATA_DISABLED=true
diff --git a/docs/en/docs/lakehouse/multi-catalog/hudi.md
b/docs/en/docs/lakehouse/multi-catalog/hudi.md
index a52c2370ced..3a5420319b0 100644
--- a/docs/en/docs/lakehouse/multi-catalog/hudi.md
+++ b/docs/en/docs/lakehouse/multi-catalog/hudi.md
@@ -33,8 +33,8 @@ under the License.
| Table Type | Supported Query types |
| | |
-| Copy On Write | Snapshot Query + Time Travel |
-| Merge On Read | Snapshot Queries + Read Optimized Queries + Time Travel |
+| Copy On Write | Snapshot Query, Time Travel, Icremental Read |
+| Merge On Read | Snapshot Queries, Read Optimized Queries, Time Travel,
Icremental Read |
2. Doris supports Hive Metastore(Including catalogs compatible with Hive
MetaStore, like [AWS Glue](./hive.md)/[Alibaba DLF](./dlf.md)) Catalogs.
@@ -94,16 +94,29 @@ Users can view the perfomace of Java SDK through
[profile](../../admin-manual/ht
## Time Travel
-Supports reading snapshots specified in Hudi table.
-
-Every write operation to the Hudi table will generate a new snapshot.
-
-By default, query requests will only read the latest version of the snapshot.
+Every write operation to the Hudi table will generate a new snapshot. [Time
Travel](https://hudi.apache.org/docs/0.14.0/quick-start-guide/#timetravel)
supports reading snapshots specified in Hudi table. By default, query requests
will only read the latest version of the snapshot.
You can use the `FOR TIME AS OF` statement, based on the time of the snapshot
to read historical version data. Examples are as follows:
+```
+SELECT * FROM hudi_tbl FOR TIME AS OF "2022-10-07 17:20:37";
+SELECT * FROM hudi_tbl FOR TIME AS OF "20221007172037";
+SELECT * FROM hudi_tbl FOR TIME AS OF "2022-10-07";
+```
+Hudi table does not support the `FOR VERSION AS OF` statement. Using this
syntax to query the Hudi table will throw an error.
-`SELECT * FROM hudi_tbl FOR TIME AS OF "2022-10-07 17:20:37";`
+## Incremental Read
+Incremental Read obtains a set of records that changed between a start and end
commit time, providing you with the "latest state" for each such record as of
the end commit time.
-`SELECT * FROM hudi_tbl FOR TIME AS OF "20221007172037";`
+Doris uses `@incr` syntax to support Incremental Read:
+```
+SELECT * from hudi_table@incr('beginTime'='xxx', ['endTime'='xxx'],
['hoodie.read.timeline.holes.resolution.policy'='FAIL'], ...);
+```
+`beginTime` is required, the time format is consistent with
[hudi_table_changes](https://hudi.apache.org/docs/0.14.0/quick-start-guide/#incremental-query)
Re: [PR] [Enhancement](Nereids) Nereids supports group_commit with insert [doris]
doris-robot commented on PR #32523: URL: https://github.com/apache/doris/pull/32523#issuecomment-2019615653 TPC-DS: Total hot run time: 181580 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit d4454418265c372ccdbcf50b46ef5454dfbc1226, data reload: false query1 940 363 342 342 query2 6550186118711861 query3 6703211 224 211 query4 31753 21281 21571 21281 query5 4293394 385 385 query6 265 169 175 169 query7 4635288 285 285 query8 222 168 169 168 query9 9283233523342334 query10 562 244 253 244 query11 17321 14203 14248 14203 query12 125 84 87 84 query13 1620407 400 400 query14 9674789177877787 query15 262 189 191 189 query16 8174271 271 271 query17 1940589 562 562 query18 2063291 276 276 query19 339 153 160 153 query20 90 89 87 87 query21 209 128 130 128 query22 5000480647584758 query23 33843 32759 33041 32759 query24 11127 288528482848 query25 612 385 391 385 query26 1202158 158 158 query27 2940346 357 346 query28 7379189618871887 query29 896 656 634 634 query30 308 153 149 149 query31 963 756 725 725 query32 98 60 60 60 query33 765 258 254 254 query34 993 484 492 484 query35 845 611 614 611 query36 1031863 887 863 query37 141 68 66 66 query38 3566342034333420 query39 1459142714091409 query40 211 118 112 112 query41 51 47 48 47 query42 101 94 99 94 query43 495 449 444 444 query44 1139726 720 720 query45 277 264 260 260 query46 722 710 710 query47 1920182418321824 query48 456 365 362 362 query49 1158341 320 320 query50 757 374 367 367 query51 6758673967756739 query52 103 93 94 93 query53 343 270 276 270 query54 298 245 236 236 query55 86 80 81 80 query56 244 225 222 222 query57 1220113111611131 query58 245 212 211 211 query59 2781241524912415 query60 271 247 248 247 query61 112 110 112 110 query62 674 451 443 443 query63 304 285 271 271 query64 5791403740154015 query65 3118301830163016 query66 875 371 359 359 query67 15316 14871 14690 14690 query68 8761539 525 525 query69 640 382 376 376 query70 1283112711501127 query71 510 271 262 262 query72 7244271525392539 query73 1009319 320 319 query74 6871643764516437 query75 3903220321802180 query76 4929881 865 865 query77 659 259 265 259 query78 10914 10167 10099 10099 query79 10410 532 523 523 query80 2046370 363 363 query81 518 215 212 212 query82 529 87 89 87 query83 212 147 145 145 query84 289 83 78 78 query85 1245318 311 311 query86 395 302 319 302 query87 3747354935553549 query88 4965238623912386 query89 495 368 363 363 query90 1953181 177 177 query91 180 141 137 137 query92 70 47 48 47 query93 7275503 490 490 query94 1242181 177 177 query95 438 332 338 332 query96 599 281 274 274 query97 2646246925112469 query98 237 216 202 202 query99 1200947 924 924 Total cold run time: 313820 ms Total hot run time: 181580 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
(doris) 01/06: [monir] remove unused cluster code (#31360)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
commit 8714dde34fcc77b4ccad618712e7686750ff9222
Author: Mingyu Chen
AuthorDate: Sat Feb 24 16:23:20 2024 +0800
[monir] remove unused cluster code (#31360)
* [monir] remove unused cluster code
* 2
---
.../java/org/apache/doris/qe/ConnectContext.java | 85 +-
1 file changed, 84 insertions(+), 1 deletion(-)
diff --git a/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectContext.java
b/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectContext.java
index 770e18a0fa4..be16bc393a4 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectContext.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectContext.java
@@ -138,7 +138,8 @@ public class ConnectContext {
protected volatile long currentDbId = -1;
// Transaction
protected volatile TransactionEntry txnEntry = null;
-
+// used for ShowSqlAction which don't allow a user account
+protected volatile boolean noAuth = false;
// username@host of current login user
protected volatile String qualifiedUser;
// LDAP authenticated but the Doris account does not exist,
@@ -1044,6 +1045,88 @@ public class ConnectContext {
return "stmt[" + stmtId + ", " + DebugUtil.printId(queryId) + "]";
}
+<<< HEAD
+===
+// maybe user set cluster by SQL hint of session variable: cloud_cluster
+// so first check it and then get from connect context.
+public String getCurrentCloudCluster() {
+String cluster = getSessionVariable().getCloudCluster();
+if (Strings.isNullOrEmpty(cluster)) {
+cluster = getCloudCluster();
+}
+return cluster;
+}
+
+public void setCloudCluster(String cluster) {
+this.cloudCluster = cluster;
+}
+
+/**
+ * @return Returns an available cluster in the following order
+ * 1 Use an explicitly specified cluster
+ * 2 If no cluster is specified, the user's default cluster is used
+ * 3 If the user does not have a default cluster, select a cluster
with permissions for the user
+ * Returns null when there is no available cluster
+ */
+public String getCloudCluster() {
+String cluster = null;
+if (!Strings.isNullOrEmpty(this.cloudCluster)) {
+cluster = this.cloudCluster;
+}
+
+String defaultCluster = getDefaultCloudCluster();
+if (!Strings.isNullOrEmpty(defaultCluster)) {
+cluster = defaultCluster;
+}
+
+String authorizedCluster = getAuthorizedCloudCluster();
+if (!Strings.isNullOrEmpty(authorizedCluster)) {
+cluster = authorizedCluster;
+}
+
+if (Strings.isNullOrEmpty(cluster)) {
+LOG.warn("cant get a valid cluster for user {} to use",
getCurrentUserIdentity());
+getState().setError(ErrorCode.ERR_NO_CLUSTER_ERROR,
+"Cant get a Valid cluster for you to use, plz connect
admin");
+} else {
+this.cloudCluster = cluster;
+LOG.info("finally set context cluster name {}", cloudCluster);
+}
+
+return cluster;
+}
+
+// TODO implement this function
+public String getDefaultCloudCluster() {
+return null;
+}
+
+public String getAuthorizedCloudCluster() {
+List cloudClusterNames = ((CloudSystemInfoService)
Env.getCurrentSystemInfo()).getCloudClusterNames();
+// get all available cluster of the user
+for (String cloudClusterName : cloudClusterNames) {
+// find a cluster has more than one alive be
+List bes = ((CloudSystemInfoService)
Env.getCurrentSystemInfo())
+.getBackendsByClusterName(cloudClusterName);
+AtomicBoolean hasAliveBe = new AtomicBoolean(false);
+bes.stream().filter(Backend::isAlive).findAny().ifPresent(backend
-> {
+if (LOG.isDebugEnabled()) {
+LOG.debug("get a clusterName {}, it's has more than one
alive be {}", cloudClusterName, backend);
+}
+hasAliveBe.set(true);
+});
+if (hasAliveBe.get()) {
+if (LOG.isDebugEnabled()) {
+LOG.debug("set context cluster name {}", cloudClusterName);
+}
+return cloudClusterName;
+}
+}
+
+return null;
+}
+
+>>> c2fe99f7c2 ([monir] remove unused cluster code (#31360))
public StatsErrorEstimator getStatsErrorEstimator() {
return statsErrorEstimator;
}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.1 updated (983e5df8123 -> f9ae03ac3c7)
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git from 983e5df8123 Fix compile (#32818) new 8714dde34fc [monir] remove unused cluster code (#31360) new ec43f65235a [feature](hudi) support hudi incremental read (#32052) new 37c8cc040d6 [feature-wip](ranger)support datamask and row filter (#32137) new c0d7a5660e0 [fix](paimon) support paimon with hive2 (#32455) new 0a2d7379fcf [enhance](auth)row policy support catalog and match name instead id (#32310) new f9ae03ac3c7 [feature](Nereids) support data masking policy (#32526) The 6 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: bin/start_be.sh| 12 +- build.sh | 10 +- conf/be.conf |2 +- docs/en/docs/lakehouse/multi-catalog/hudi.md | 33 +- docs/zh-CN/docs/lakehouse/multi-catalog/hudi.md| 37 +- .../java/org/apache/doris/hudi/HudiJniScanner.java | 12 +- .../hudi-scanner/src/main/resources/package.xml| 20 +- .../org/apache/doris/hudi/BaseSplitReader.scala|8 +- .../apache/doris/hudi/HoodieRecordIterator.scala | 67 +- .../doris/hudi/MORIncrementalSplitReader.scala | 86 + .../apache/doris/hudi/MORSnapshotSplitReader.scala |2 +- .../java-common/src/main/resources/package.xml | 20 +- .../jdbc-scanner/src/main/resources/package.xml| 20 +- .../src/main/resources/package.xml | 20 +- .../paimon-scanner/src/main/resources/package.xml | 20 +- fe/be-java-extensions/preload-extensions/pom.xml | 29 +- .../hadoop/hive/metastore/HiveMetaStoreClient.java | 3630 .../hadoop/hive/metastore}/HiveVersionUtil.java| 33 +- .../src/main/resources/package-deps.xml} |7 +- .../src/main/resources/package-proj.xml} | 22 +- .../src/main/resources/package.xml | 41 - fe/check/checkstyle/suppressions.xml |1 + .../antlr4/org/apache/doris/nereids/DorisParser.g4 |6 +- fe/fe-core/src/main/cup/sql_parser.cup | 16 +- .../org/apache/doris/analysis/StmtRewriter.java| 15 +- .../java/org/apache/doris/analysis/TableRef.java | 14 + .../org/apache/doris/analysis/TableScanParams.java | 46 + .../authorizer/ranger/RangerAccessController.java | 78 + .../ranger/doris/RangerDorisAccessController.java | 56 +- .../ranger/hive/RangerHiveAccessController.java| 73 +- .../doris/datasource/hive/HMSExternalTable.java| 100 +- .../doris/datasource/hive/HiveVersionUtil.java | 31 +- .../hudi/source/COWIncrementalRelation.java| 254 ++ .../doris/datasource/hudi/source/HudiScanNode.java | 175 +- .../hudi/source/IncrementalRelation.java | 44 + .../hudi/source/MORIncrementalRelation.java| 217 ++ .../datasource/paimon/PaimonExternalCatalog.java | 26 +- .../paimon/PaimonFileExternalCatalog.java |2 +- .../paimon/PaimonHMSExternalCatalog.java |1 + .../property/constants/PaimonProperties.java |2 +- .../mysql/privilege/AccessControllerManager.java | 31 + .../mysql/privilege/CatalogAccessController.java |7 + .../doris/mysql/privilege/DataMaskPolicy.java | 24 + .../mysql/privilege/InternalAccessController.java | 15 + .../mysql/privilege/RangerDataMaskPolicy.java | 103 + .../mysql/privilege/RangerRowFilterPolicy.java | 95 + .../doris/mysql/privilege/RowFilterPolicy.java | 32 + .../doris/nereids/analyzer/UnboundRelation.java| 34 +- .../doris/nereids/parser/LogicalPlanBuilder.java |9 +- .../doris/nereids/rules/analysis/BindRelation.java |8 +- .../doris/nereids/rules/analysis/CheckPolicy.java | 33 +- .../trees/plans/logical/LogicalCheckPolicy.java| 96 +- .../org/apache/doris/policy/DropPolicyLog.java | 42 +- .../main/java/org/apache/doris/policy/Policy.java | 11 +- .../java/org/apache/doris/policy/PolicyMgr.java| 126 +- .../java/org/apache/doris/policy/RowPolicy.java| 69 +- .../java/org/apache/doris/qe/ConnectContext.java |3 +- .../hadoop/hive/metastore/HiveMetaStoreClient.java |4 + .../apache/doris/datasource/ColumnPrivTest.java| 15 + .../nereids/privileges/TestCheckPrivileges.java| 213 +- .../data/external_table_p2/hive/test_hive_hudi.out | 12 + .../external_table_p2/hive/test_hive_hudi.groovy |6 + 62 files changed, 5817 insertions(+), 459 deletions(-) create mode 100644 fe/be-java-extensions/hudi-scanner/src/main/scala/org/apache/doris/hudi/MORIncrementalSplitReader.scala create mode 100644 fe/be-jav
Re: [PR] [fix](hdfs) Add basic multi vault case for regression-test and Meta Service's UT [doris]
github-actions[bot] commented on PR #32791: URL: https://github.com/apache/doris/pull/32791#issuecomment-2019637618 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Enhancement](Nereids) Nereids supports group_commit with insert [doris]
doris-robot commented on PR #32523: URL: https://github.com/apache/doris/pull/32523#issuecomment-2019646433 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit d4454418265c372ccdbcf50b46ef5454dfbc1226 with default session variables Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s Insert into select: 21.8 seconds inserted 1000 Rows, about 458K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](multicatalog) fix no data error when read hive table on cosn [doris]
doris-robot commented on PR #32815: URL: https://github.com/apache/doris/pull/32815#issuecomment-2019647201 TPC-H: Total hot run time: 38489 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit be39c2df5bbbf1b25fc5ad92017d2d2cd6159425, data reload: false -- Round 1 -- q1 17643 444541154115 q2 2111159 159 159 q3 11420 117212361172 q4 11016 734 789 734 q5 7655308830723072 q6 209 129 125 125 q7 1073640 589 589 q8 9492211720262026 q9 7392679867356735 q10 8757354636723546 q11 456 231 231 231 q12 382 203 200 200 q13 18880 284628912846 q14 227 202 207 202 q15 502 460 469 460 q16 495 374 380 374 q17 973 544 652 544 q18 7318646765036467 q19 1569147814101410 q20 560 285 252 252 q21 3654294029302930 q22 342 300 304 300 Total cold run time: 112126 ms Total hot run time: 38489 ms - Round 2, with runtime_filter_mode=off - q1 4170409940864086 q2 326 226 237 226 q3 3006287528792875 q4 1868156415751564 q5 5266537653925376 q6 196 116 116 116 q7 2245188318471847 q8 3166329632873287 q9 8850872587158715 q10 3782376338173763 q11 553 450 443 443 q12 729 564 568 564 q13 16921 284828982848 q14 282 250 263 250 q15 499 461 461 461 q16 470 423 428 423 q17 1741146614681466 q18 7513712470597059 q19 1642156214991499 q20 1908173717051705 q21 4863482947724772 q22 568 459 468 459 Total cold run time: 70564 ms Total hot run time: 53804 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [draft](merge-cloud) introduce copy into [doris]
github-actions[bot] commented on PR #32759: URL: https://github.com/apache/doris/pull/32759#issuecomment-2019648943 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](join) core caused by null-safe-equal join (#32623) [doris]
doris-robot commented on PR #32821: URL: https://github.com/apache/doris/pull/32821#issuecomment-2019689531 TPC-DS: Total hot run time: 202430 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 6c3822fc0ec51d01675d0ce991711a60a0a69077, data reload: false query1 949 394 379 379 query2 6542228020722072 query3 6919201 203 201 query4 20062 18138 18064 18064 query5 19739 660966046604 query6 309 217 223 217 query7 4349309 305 305 query8 244 254 239 239 query9 3072267425872587 query10 421 283 295 283 query11 11396 10774 10715 10715 query12 129 82 73 73 query13 5590661 652 652 query14 18262 13891 13723 13723 query15 368 256 234 234 query16 6437266 262 262 query17 15111497868 868 query18 2294406 405 405 query19 202 141 147 141 query20 86 76 73 73 query21 188 102 95 95 query22 5199496450774964 query23 32515 32175 32119 32119 query24 6786652666026526 query25 523 435 424 424 query26 523 164 159 159 query27 1884297 309 297 query28 6125223921982198 query29 2898281026372637 query30 258 165 163 163 query31 906 747 733 733 query32 71 53 64 53 query33 377 252 239 239 query34 870 488 475 475 query35 1104899 912 899 query36 1304109212011092 query37 93 62 59 59 query38 3070294429162916 query39 1381134713371337 query40 207 98 102 98 query41 40 32 31 31 query42 95 84 83 83 query43 725 629 543 543 query44 1147732 723 723 query45 242 226 225 225 query46 1252983 1026983 query47 1986175317321732 query48 1005697 674 674 query49 613 355 361 355 query50 860 594 623 594 query51 4772462646574626 query52 87 92 84 84 query53 450 320 319 319 query54 2673245124822451 query55 90 77 88 77 query56 217 209 186 186 query57 1281110210241024 query58 200 209 198 198 query59 3563317032223170 query60 200 210 186 186 query61 84 84 87 84 query62 826 471 498 471 query63 467 338 333 333 query64 2460150812941294 query65 3717360235873587 query66 760 369 354 354 query67 15809 15559 15839 15559 query68 8247679 677 677 query69 581 359 354 354 query70 1909137915611379 query71 421 299 317 299 query72 6669345534183418 query73 742 332 326 326 query74 6304586058445844 query75 4577373537843735 query76 4555117812141178 query77 537 248 259 248 query78 12667 11830 11772 11772 query79 7935658 652 652 query80 1688408 409 408 query81 509 248 237 237 query82 1556107 100 100 query83 178 135 132 132 query84 259 68 68 68 query85 1250285 279 279 query86 361 289 336 289 query87 3179297730352977 query88 5084234723472347 query89 347 303 302 302 query90 1800212 209 209 query91 153 116 116 116 query92 57 50 49 49 query93 3992577 594 577 query94 879 197 204 197 query95 1116105810741058 query96 651 316 337 316 query97 6528633964196339 query98 177 179 171 171 query99 29881020851 851 Total cold run time: 308680 ms Total hot run time: 202430 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go
Re: [PR] [fix](pipeline) fix use error row desc when origin block clear [doris]
doris-robot commented on PR #32803: URL: https://github.com/apache/doris/pull/32803#issuecomment-2019692376 TPC-H: Total hot run time: 38039 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ee26304ef83b2a66471f01d77f871dbb2c10264f, data reload: false -- Round 1 -- q1 17662 425841444144 q2 2106169 163 163 q3 10565 113312251133 q4 10241 810 768 768 q5 7473303629922992 q6 205 126 125 125 q7 1067601 578 578 q8 9344202120112011 q9 7208663666136613 q10 8421345635863456 q11 428 234 220 220 q12 404 204 194 194 q13 17809 289128312831 q14 236 211 197 197 q15 516 463 450 450 q16 499 377 365 365 q17 948 533 596 533 q18 7106653564956495 q19 3167142414741424 q20 549 264 239 239 q21 3583290428272827 q22 350 281 295 281 Total cold run time: 109887 ms Total hot run time: 38039 ms - Round 2, with runtime_filter_mode=off - q1 4142406741554067 q2 323 246 240 240 q3 2933288128152815 q4 1843156615191519 q5 5307529353305293 q6 194 114 119 114 q7 2225183918811839 q8 3158330032683268 q9 8640868887078688 q10 3795375937903759 q11 535 441 440 440 q12 707 549 507 507 q13 16974 287528262826 q14 272 243 241 241 q15 489 471 448 448 q16 471 409 411 409 q17 1722147814831478 q18 7494710471417104 q19 1608154615501546 q20 1904174316921692 q21 4779459045584558 q22 528 450 445 445 Total cold run time: 70043 ms Total hot run time: 53296 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids): handle distinct and nullable property when rewriting sum literal [doris]
XieJiann commented on PR #32778: URL: https://github.com/apache/doris/pull/32778#issuecomment-2019694609 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](hdfs) Correct Storage Vault's key layout && Add basic multi vault case for regression-test && Meta Service's UT [doris]
github-actions[bot] commented on PR #32791: URL: https://github.com/apache/doris/pull/32791#issuecomment-2019698569 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](insert)fix hive external return msgs and exception and pass all columns to BE [doris]
wsjz opened a new pull request, #32824: URL: https://github.com/apache/doris/pull/32824 ## Proposed changes Issue Number: https://github.com/apache/doris/issues/31442 ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [draft](merge-cloud) introduce copy into [doris]
github-actions[bot] commented on PR #32759: URL: https://github.com/apache/doris/pull/32759#issuecomment-2019705747 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](hive/iceberg)add doris's version in table properties [doris]
doris-robot commented on PR #32774: URL: https://github.com/apache/doris/pull/32774#issuecomment-2019708532 TPC-H: Total hot run time: 37776 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 9c718c27b662ff4aab004f8a6a2d60d92a56a556, data reload: false -- Round 1 -- q1 17715 414641114111 q2 2113174 156 156 q3 10563 117111801171 q4 10225 777 746 746 q5 7463300729492949 q6 201 125 122 122 q7 1012575 555 555 q8 9338197419561956 q9 7189663466056605 q10 8471349835813498 q11 428 218 215 215 q12 392 196 192 192 q13 17802 285228652852 q14 231 201 202 201 q15 505 457 456 456 q16 500 369 369 369 q17 935 605 570 570 q18 6935641363046304 q19 2941138914031389 q20 543 247 244 244 q21 3487283329202833 q22 338 296 282 282 Total cold run time: 109327 ms Total hot run time: 37776 ms - Round 2, with runtime_filter_mode=off - q1 4178407540504050 q2 331 237 227 227 q3 2954283028362830 q4 1830153415381534 q5 5282531452885288 q6 212 116 117 116 q7 2246184018451840 q8 3175341732683268 q9 8671866186388638 q10 3795376438003764 q11 533 455 443 443 q12 754 558 569 558 q13 16932 282828342828 q14 283 253 258 253 q15 486 455 457 455 q16 474 428 428 428 q17 1712147414861474 q18 7361725971287128 q19 1590152615051505 q20 1889174816971697 q21 4809463146154615 q22 547 471 450 450 Total cold run time: 70044 ms Total hot run time: 53389 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](arrow-flight) Fix arrow flight sql compatible with JDK 11 and upgrade arrow 15.0.2 [doris]
doris-robot commented on PR #32796: URL: https://github.com/apache/doris/pull/32796#issuecomment-2019710714 TPC-H: Total hot run time: 37591 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ee2ee085ec9e0ac82028da0d0579d1b37fd04e46, data reload: false -- Round 1 -- q1 17661 417240724072 q2 2112162 156 156 q3 10579 117912031179 q4 10231 711 676 676 q5 7458296529772965 q6 200 125 123 123 q7 1043596 563 563 q8 9331200719841984 q9 7160657165246524 q10 8448341035783410 q11 431 229 214 214 q12 364 208 198 198 q13 17807 286728272827 q14 226 204 203 203 q15 520 460 454 454 q16 491 387 375 375 q17 945 514 659 514 q18 7012651764366436 q19 4738141114431411 q20 549 267 255 255 q21 3529275629702756 q22 348 298 296 296 Total cold run time: 83 ms Total hot run time: 37591 ms - Round 2, with runtime_filter_mode=off - q1 4152412140744074 q2 326 227 228 227 q3 2950284928342834 q4 1835160715281528 q5 5285533653285328 q6 196 118 118 118 q7 2216182218561822 q8 3154325532613255 q9 8658865486488648 q10 3797375337983753 q11 539 440 445 440 q12 729 539 559 539 q13 16915 286328252825 q14 281 257 257 257 q15 507 469 474 469 q16 503 440 426 426 q17 1714150014691469 q18 7445710971077107 q19 2806151615361516 q20 1928174016931693 q21 4737454345554543 q22 545 458 470 458 Total cold run time: 71218 ms Total hot run time: 53329 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](hdfs) Correct Storage Vault's key layout && Add basic multi vault case for regression-test && Meta Service's UT [doris]
doris-robot commented on PR #32791: URL: https://github.com/apache/doris/pull/32791#issuecomment-2019710910 TPC-H: Total hot run time: 39784 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 163dda6baeea8db807b0688afae44e6af448b674, data reload: false -- Round 1 -- q1 17617 476245434543 q2 2114157 154 154 q3 10579 119912651199 q4 10227 880 798 798 q5 7489325032223222 q6 220 126 124 124 q7 1100595 566 566 q8 9346216121512151 q9 7780702069586958 q10 8500359637203596 q11 434 220 215 215 q12 428 200 201 200 q13 17782 283428142814 q14 250 211 212 211 q15 519 453 456 453 q16 514 368 368 368 q17 995 662 588 588 q18 7097654764366436 q19 2945154516191545 q20 553 250 245 245 q21 3827320531003100 q22 361 298 307 298 Total cold run time: 110677 ms Total hot run time: 39784 ms - Round 2, with runtime_filter_mode=off - q1 4543448344784478 q2 344 231 227 227 q3 3043291828882888 q4 1945162216081608 q5 5434546154525452 q6 215 117 117 117 q7 2320187418781874 q8 3388355935573557 q9 8816882788238823 q10 3924390038943894 q11 560 441 451 441 q12 729 546 537 537 q13 16926 285828552855 q14 287 249 259 249 q15 506 465 465 465 q16 478 432 435 432 q17 1873157915421542 q18 7568730971387138 q19 1774170317141703 q20 1980173717041704 q21 4999478249204782 q22 541 462 454 454 Total cold run time: 72193 ms Total hot run time: 55220 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](statistics)Support identical column name in different index. [doris]
doris-robot commented on PR #32792: URL: https://github.com/apache/doris/pull/32792#issuecomment-2019711334 TPC-H: Total hot run time: 37614 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit bd148846b7d3a5b97ec5e74f334a14cf6f4ba6b7, data reload: false -- Round 1 -- q1 17682 424340394039 q2 2099160 148 148 q3 10582 108311761083 q4 10227 756 769 756 q5 7463301929792979 q6 200 124 122 122 q7 1028574 564 564 q8 9333199919471947 q9 7132656865466546 q10 8432345935443459 q11 439 221 214 214 q12 407 199 192 192 q13 17795 284128452841 q14 241 193 202 193 q15 503 466 463 463 q16 485 375 377 375 q17 937 612 567 567 q18 7041641163526352 q19 1523140514531405 q20 554 269 258 258 q21 3520292028102810 q22 339 301 305 301 Total cold run time: 107962 ms Total hot run time: 37614 ms - Round 2, with runtime_filter_mode=off - q1 4106404940164016 q2 328 228 234 228 q3 2946280728542807 q4 1791156615131513 q5 5265532253185318 q6 194 117 119 117 q7 2215185318371837 q8 3138329432823282 q9 8627869586488648 q10 3771382439673824 q11 554 470 464 464 q12 762 598 597 597 q13 17100 301530793015 q14 298 266 297 266 q15 526 489 479 479 q16 500 459 465 459 q17 1775154615031503 q18 7986783174997499 q19 3961155415401540 q20 2003183617131713 q21 4929476747984767 q22 559 466 458 458 Total cold run time: 73334 ms Total hot run time: 54350 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](insert)fix hive table sink type coercion and unify coercion [doris]
doris-robot commented on PR #32762: URL: https://github.com/apache/doris/pull/32762#issuecomment-2019712088 TPC-DS: Total hot run time: 181216 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 03c11715c0f4150e2181e1f97d7da191e7dd5a74, data reload: false query1 937 354 365 354 query2 6540187318401840 query3 6708210 211 210 query4 31702 21268 21271 21268 query5 4301401 403 401 query6 279 178 174 174 query7 4620285 303 285 query8 231 162 175 162 query9 9043235423652354 query10 555 248 250 248 query11 17229 14125 14232 14125 query12 135 89 86 86 query13 1628410 410 410 query14 10104 795679047904 query15 254 210 204 204 query16 8175279 262 262 query17 1924587 559 559 query18 2107298 281 281 query19 301 157 156 156 query20 89 89 87 87 query21 207 134 130 130 query22 4971479347304730 query23 33686 32631 32542 32542 query24 10722 291328102810 query25 580 389 399 389 query26 724 160 161 160 query27 2223351 364 351 query28 5811187218681868 query29 900 661 643 643 query30 307 152 150 150 query31 1019761 714 714 query32 93 57 56 56 query33 663 257 248 248 query34 874 490 487 487 query35 828 619 618 618 query36 1015890 882 882 query37 97 68 67 67 query38 3567346634243424 query39 1462148214171417 query40 208 128 123 123 query41 51 47 49 47 query42 104 97 94 94 query43 469 460 455 455 query44 1097723 711 711 query45 272 272 268 268 query46 1118692 685 685 query47 1901184018431840 query48 430 385 350 350 query49 1088340 338 338 query50 763 379 381 379 query51 6840685567336733 query52 112 90 91 90 query53 351 277 279 277 query54 301 233 231 231 query55 84 80 83 80 query56 257 232 227 227 query57 1210115011301130 query58 237 211 215 211 query59 2836259426742594 query60 262 247 247 247 query61 114 112 110 110 query62 675 454 463 454 query63 309 274 278 274 query64 5456409840334033 query65 3064300329892989 query66 890 367 351 351 query67 15220 15018 14548 14548 query68 7667524 527 524 query69 636 379 368 368 query70 1215113510921092 query71 487 261 265 261 query72 6481272825412541 query73 727 320 334 320 query74 7740639464076394 query75 3946223822012201 query76 4888857 881 857 query77 655 256 255 255 query78 10850 10278 10054 10054 query79 10152 512 516 512 query80 1777396 374 374 query81 542 211 222 211 query82 846 90 90 90 query83 225 143 141 141 query84 289 77 78 77 query85 1337325 305 305 query86 468 274 293 274 query87 3727355135453545 query88 4940237923752375 query89 488 374 366 366 query90 1941179 179 179 query91 168 135 133 133 query92 59 48 47 47 query93 6952504 488 488 query94 1171177 184 177 query95 449 333 334 333 query96 610 265 275 265 query97 2674250224762476 query98 237 212 207 207 query99 1251931 849 849 Total cold run time: 307925 ms Total hot run time: 181216 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
Re: [PR] [enhancement](cloud) add table version to cloud [doris]
doris-robot commented on PR #32738: URL: https://github.com/apache/doris/pull/32738#issuecomment-2019712251 TPC-DS: Total hot run time: 181406 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 8a3ea4470aa9b2b057881af6c86095772911608c, data reload: false query1 933 367 345 345 query2 6555187218261826 query3 6710212 214 212 query4 31577 21298 21234 21234 query5 4371404 387 387 query6 272 182 171 171 query7 4641302 288 288 query8 228 182 170 170 query9 9197237723662366 query10 561 246 255 246 query11 17559 14285 14192 14192 query12 147 90 86 86 query13 1622414 422 414 query14 10098 796675447544 query15 270 203 200 200 query16 8235262 261 261 query17 1985594 562 562 query18 2107288 278 278 query19 355 161 156 156 query20 94 93 88 88 query21 204 129 132 129 query22 5016485048304830 query23 33595 32848 32946 32848 query24 10757 288028492849 query25 612 399 395 395 query26 1172162 162 162 query27 2551355 359 355 query28 7213187718731873 query29 866 612 614 612 query30 297 151 150 150 query31 939 735 719 719 query32 89 56 54 54 query33 762 271 237 237 query34 1057467 484 467 query35 821 623 599 599 query36 1018870 884 870 query37 119 68 62 62 query38 3580342834073407 query39 1498142514271425 query40 209 116 110 110 query41 48 46 46 46 query42 99 97 94 94 query43 471 439 440 439 query44 1224711 711 711 query45 265 249 262 249 query46 1122692 708 692 query47 1928186218541854 query48 449 345 356 345 query49 1100326 320 320 query50 762 375 363 363 query51 6839680568066805 query52 106 92 92 92 query53 346 275 277 275 query54 294 233 235 233 query55 88 77 81 77 query56 261 215 221 215 query57 1209112611381126 query58 221 204 204 204 query59 2789267424552455 query60 247 241 247 241 query61 98 101 100 100 query62 654 469 453 453 query63 306 270 273 270 query64 5728419241354135 query65 3053303930243024 query66 879 391 372 372 query67 15129 14832 14543 14543 query68 5303524 519 519 query69 585 372 385 372 query70 1202117011351135 query71 424 275 267 267 query72 6381286126642664 query73 714 320 324 320 query74 7514640364316403 query75 2981219922552199 query76 3555927 876 876 query77 409 255 249 249 query78 10785 10106 99639963 query79 7933511 523 511 query80 1818384 380 380 query81 557 222 211 211 query82 134290 85 85 query83 291 146 153 146 query84 287 80 76 76 query85 2058327 309 309 query86 495 323 304 304 query87 3712353635323532 query88 5079239124162391 query89 478 368 383 368 query90 1969181 178 178 query91 179 133 140 133 query92 62 49 49 49 query93 5814492 482 482 query94 1263188 180 180 query95 449 337 333 333 query96 621 273 270 270 query97 2647246524842465 query98 239 218 216 216 query99 1182908 920 908 Total cold run time: 303935 ms Total hot run time: 181406 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [fix](insert)fix hive external return msgs and exception and pass all columns to BE [doris]
doris-robot commented on PR #32824: URL: https://github.com/apache/doris/pull/32824#issuecomment-2019700453 Thank you for your contribution to Apache Doris. Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR) Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website). See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](join) core caused by null-safe-equal join (#32623) [doris]
doris-robot commented on PR #32821: URL: https://github.com/apache/doris/pull/32821#issuecomment-2019717872 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 6c3822fc0ec51d01675d0ce991711a60a0a69077 with default session variables Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 22.4 seconds inserted 1000 Rows, about 446K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] debug mysqlload [doris]
dataroaring commented on PR #32716: URL: https://github.com/apache/doris/pull/32716#issuecomment-2019704286 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](arrow-flight) BE upgrade arrow to 15.0.2 [doris]
doris-robot commented on PR #32805: URL: https://github.com/apache/doris/pull/32805#issuecomment-2019709515 TPC-H: Total hot run time: 37736 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit bb300df7ec9b8edc2c41528c7daf1b86c3bf267d, data reload: false -- Round 1 -- q1 17643 420140954095 q2 2107158 151 151 q3 10586 109912001099 q4 10227 772 775 772 q5 7447299729592959 q6 205 125 122 122 q7 1009572 571 571 q8 9321198919881988 q9 7198657065366536 q10 8427348035473480 q11 430 229 213 213 q12 375 202 193 193 q13 17789 285128312831 q14 239 205 214 205 q15 502 467 453 453 q16 497 376 375 375 q17 945 533 612 533 q18 7015642163816381 q19 2143143714971437 q20 547 270 241 241 q21 3542291228072807 q22 340 294 306 294 Total cold run time: 108534 ms Total hot run time: 37736 ms - Round 2, with runtime_filter_mode=off - q1 4121409840584058 q2 319 228 226 226 q3 2973283028272827 q4 1842156015821560 q5 5282529153105291 q6 192 113 115 113 q7 2223186718821867 q8 3117328032593259 q9 8669866186578657 q10 3774378237723772 q11 550 435 459 435 q12 696 577 541 541 q13 16935 283228002800 q14 276 252 250 250 q15 493 464 447 447 q16 481 431 425 425 q17 1723148814611461 q18 7433717769686968 q19 1613153015501530 q20 1904174416951695 q21 4744463646744636 q22 505 454 458 454 Total cold run time: 69865 ms Total hot run time: 53272 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](arrow-flight) BE upgrade arrow to 15.0.2 [doris]
xinyiZzz commented on PR #32805: URL: https://github.com/apache/doris/pull/32805#issuecomment-2019711266 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](join) core caused by null-safe-equal join (#32623) [doris]
mrhhsg commented on PR #32821: URL: https://github.com/apache/doris/pull/32821#issuecomment-2019716867 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [bug](distinct agg) fix distinct streaming agg not output all data [doris]
doris-robot commented on PR #32760: URL: https://github.com/apache/doris/pull/32760#issuecomment-2019718022 TPC-DS: Total hot run time: 181945 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ee5fa0efd1d448919702406b26d53eca4c351cd2, data reload: false query1 945 370 347 347 query2 6541200518911891 query3 6712211 208 208 query4 31560 21439 21290 21290 query5 4300404 390 390 query6 272 184 188 184 query7 4627292 282 282 query8 239 173 179 173 query9 9410234323262326 query10 564 262 269 262 query11 14731 14202 14259 14202 query12 137 100 85 85 query13 1635435 426 426 query14 10900 782179227821 query15 241 197 184 184 query16 8176265 273 265 query17 1982569 537 537 query18 2089284 275 275 query19 346 153 148 148 query20 89 85 82 82 query21 197 128 126 126 query22 4985484748234823 query23 33206 32701 32669 32669 query24 11072 283928162816 query25 597 364 372 364 query26 1205151 154 151 query27 2415340 350 340 query28 7208190018931893 query29 877 632 631 631 query30 305 151 152 151 query31 935 743 738 738 query32 94 58 55 55 query33 763 248 238 238 query34 1017470 486 470 query35 845 607 621 607 query36 1035894 879 879 query37 122 67 60 60 query38 3530343534163416 query39 1460142714201420 query40 197 111 108 108 query41 50 44 44 44 query42 104 94 95 94 query43 491 467 468 467 query44 1136722 714 714 query45 258 251 257 251 query46 1101690 692 690 query47 1931182718371827 query48 431 357 362 357 query49 1108336 320 320 query50 770 377 365 365 query51 6947678868816788 query52 108 88 95 88 query53 345 279 279 279 query54 297 227 233 227 query55 79 73 76 73 query56 242 222 216 216 query57 1186113311371133 query58 221 203 209 203 query59 2881266925762576 query60 258 235 238 235 query61 100 126 114 114 query62 653 450 449 449 query63 308 285 274 274 query64 5821413739983998 query65 3095304230283028 query66 894 382 373 373 query67 15095 15072 15010 15010 query68 5373520 525 520 query69 555 386 373 373 query70 1224118811101110 query71 438 271 271 271 query72 6606285326542654 query73 709 319 321 319 query74 7048642963826382 query75 2951218522242185 query76 3510896 854 854 query77 382 268 262 262 query78 10896 10061 10090 10061 query79 8552523 519 519 query80 2223397 397 397 query81 546 213 216 213 query82 135786 88 86 query83 277 140 142 140 query84 286 83 77 77 query85 2075318 305 305 query86 485 288 312 288 query87 3804354835253525 query88 5011235623562356 query89 539 377 361 361 query90 1997175 178 175 query91 167 141 136 136 query92 64 50 46 46 query93 6373498 484 484 query94 1238195 181 181 query95 430 332 334 332 query96 597 272 274 272 query97 2689244425112444 query98 237 214 214 214 query99 1171877 947 877 Total cold run time: 303281 ms Total hot run time: 181945 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th
Re: [PR] [Serde](Variant) support arrow serialization for varint type [doris]
doris-robot commented on PR #32780: URL: https://github.com/apache/doris/pull/32780#issuecomment-2019722983 TeamCity be ut coverage result: Function Coverage: 35.27% (8738/24777) Line Coverage: 27.05% (71556/264533) Region Coverage: 26.28% (37115/141204) Branch Coverage: 23.18% (18980/81882) Coverage Report: http://coverage.selectdb-in.cc/coverage/9d903d5a0d0eba294827a5cacbf1523f2e458ff8_9d903d5a0d0eba294827a5cacbf1523f2e458ff8/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) Fix deletestmt getting catalog [doris]
github-actions[bot] commented on PR #32701: URL: https://github.com/apache/doris/pull/32701#issuecomment-2019732336 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](nereids) Fix deletestmt getting catalog [doris]
github-actions[bot] commented on PR #32701: URL: https://github.com/apache/doris/pull/32701#issuecomment-2019732025 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [draft](merge-cloud) introduce copy into [doris]
github-actions[bot] commented on PR #32759: URL: https://github.com/apache/doris/pull/32759#issuecomment-2019733696 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Serde](Variant) support arrow serialization for varint type [doris]
doris-robot commented on PR #32780: URL: https://github.com/apache/doris/pull/32780#issuecomment-2019736323 TPC-H: Total hot run time: 37764 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 9d903d5a0d0eba294827a5cacbf1523f2e458ff8, data reload: false -- Round 1 -- q1 17672 420641024102 q2 2128153 148 148 q3 10658 116711951167 q4 10241 764 786 764 q5 7454302329612961 q6 207 126 123 123 q7 1041586 564 564 q8 9328196119671961 q9 7185661164936493 q10 8420337135433371 q11 430 220 220 220 q12 429 210 201 201 q13 17791 287928522852 q14 232 195 198 195 q15 509 452 485 452 q16 489 371 367 367 q17 953 638 584 584 q18 7067643764226422 q19 1863138914361389 q20 544 252 257 252 q21 3496289428672867 q22 364 309 311 309 Total cold run time: 108501 ms Total hot run time: 37764 ms - Round 2, with runtime_filter_mode=off - q1 4150410040824082 q2 322 232 232 232 q3 2973283128622831 q4 1860158115881581 q5 5300537753055305 q6 192 113 116 113 q7 2230186718651865 q8 3140327832463246 q9 8686865586508650 q10 3778378637793779 q11 547 452 468 452 q12 726 556 554 554 q13 16913 283628752836 q14 279 252 263 252 q15 498 455 469 455 q16 465 423 423 423 q17 1740149114371437 q18 7558719270727072 q19 1604156914971497 q20 1931170417311704 q21 4781467947964679 q22 534 438 467 438 Total cold run time: 70207 ms Total hot run time: 53483 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](insert)fix hive table sink type coercion and unify coercion [doris]
doris-robot commented on PR #32762: URL: https://github.com/apache/doris/pull/32762#issuecomment-2019739412 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 03c11715c0f4150e2181e1f97d7da191e7dd5a74 with default session variables Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 21.9 seconds inserted 1000 Rows, about 456K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
