Re: [PR] [Feature](profile)Support active_queries TVF [doris]
doris-robot commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893233281 TPC-DS: Total hot run time: 179109 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 8fac397f335a3d37ca14ce7a1962664220fb596e, data reload: false query1 935 338 333 333 query2 6717182219001822 query3 6714210 206 206 query4 33911 22411 22297 22297 query5 6962587 541 541 query6 264 185 196 185 query7 4626281 279 279 query8 238 198 207 198 query9 9194282427252725 query10 516 235 242 235 query11 16144 15447 15260 15260 query12 135 71 76 71 query13 1707377 387 377 query14 11245 741975497419 query15 212 182 181 181 query16 4616264 250 250 query17 994 493 489 489 query18 1801264 255 255 query19 182 153 150 150 query20 79 80 72 72 query21 194 125 128 125 query22 4963476647224722 query23 31780 31130 31131 31130 query24 5457291128662866 query25 407 343 334 334 query26 725 155 159 155 query27 2228282 283 282 query28 3823188518861885 query29 1019698 677 677 query30 206 138 141 138 query31 927 761 770 761 query32 72 56 64 56 query33 365 240 238 238 query34 819 460 478 460 query35 869 782 778 778 query36 1388129912051205 query37 105 66 67 66 query38 3389329232983292 query39 1334127613061276 query40 214 96 99 96 query41 42 36 39 36 query42 98 103 96 96 query43 554 519 524 519 query44 1019710 726 710 query45 204 191 184 184 query46 1057656 664 656 query47 1700161216071607 query48 415 319 331 319 query49 615 323 305 305 query50 718 318 322 318 query51 5328522252445222 query52 108 86 97 86 query53 366 291 295 291 query54 751 460 462 460 query55 92 84 89 84 query56 192 198 193 193 query57 996 939 959 939 query58 201 191 190 190 query59 3087275027462746 query60 234 222 227 222 query61 88 84 82 82 query62 488 482 415 415 query63 300 292 286 286 query64 2565166116671661 query65 3399327532813275 query66 852 335 343 335 query67 15729 14930 15137 14930 query68 14616 515 527 515 query69 650 335 332 332 query70 2292154715251525 query71 550 234 250 234 query72 5241283828402838 query73 3984313 315 313 query74 6947646763966396 query75 5663233722942294 query76 6165965 1032965 query77 833 297 295 295 query78 10157 863785298529 query79 3560505 519 505 query80 672 338 356 338 query81 489 205 208 205 query82 210 91 92 91 query83 279 131 118 118 query84 284 74 72 72 query85 1099345 327 327 query86 390 377 375 375 query87 3580343233773377 query88 3685222022252220 query89 451 378 401 378 query90 2373202 191 191 query91 154 128 141 128 query92 59 56 54 54 query93 2308417 424 417 query94 1620185 176 176 query95 511 487 463 463 query96 622 309 318 309 query97 4337417041644164 query98 217 192 184 184 query99 990 763 727 727 Total cold run time: 293662 ms Total hot run time: 179109 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [feat](Nereids): persist constraint in table [doris]
doris-robot commented on PR #29767: URL: https://github.com/apache/doris/pull/29767#issuecomment-1893237413 ClickBench: Total hot run time: 30.9 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 972dee5251fb18c212a4a55e84656046e79dfe40, data reload: false query1 0.060.050.05 query2 0.060.020.02 query3 0.260.120.12 query4 1.760.120.12 query5 0.540.520.52 query6 1.350.650.64 query7 0.020.010.02 query8 0.040.030.02 query9 0.560.500.51 query10 0.580.550.55 query11 0.120.090.08 query12 0.110.090.09 query13 0.600.600.60 query14 0.770.790.79 query15 0.800.770.78 query16 0.390.360.37 query17 1.020.991.03 query18 0.250.250.24 query19 1.841.811.74 query20 0.010.010.01 query21 15.41 0.570.60 query22 2.662.002.24 query23 17.18 0.850.75 query24 2.561.100.85 query25 0.320.180.12 query26 0.670.140.14 query27 0.050.060.06 query28 11.81 0.800.80 query29 12.56 3.223.14 query30 0.580.530.50 query31 2.770.350.36 query32 3.370.480.49 query33 3.233.213.19 query34 15.75 4.274.17 query35 4.234.274.23 query36 1.131.071.07 query37 0.060.050.05 query38 0.040.030.03 query39 0.020.010.02 query40 0.170.130.13 query41 0.070.010.02 query42 0.020.020.01 query43 0.030.020.02 Total cold run time: 105.83 s Total hot run time: 30.9 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](profile)Support active_queries TVF [doris]
doris-robot commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893240706 ClickBench: Total hot run time: 30.88 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 8fac397f335a3d37ca14ce7a1962664220fb596e, data reload: false query1 0.070.050.06 query2 0.060.020.02 query3 0.260.130.11 query4 1.780.130.11 query5 0.540.530.54 query6 1.340.650.64 query7 0.020.010.01 query8 0.030.020.02 query9 0.540.520.49 query10 0.550.550.57 query11 0.120.090.10 query12 0.110.100.09 query13 0.610.610.61 query14 0.760.820.78 query15 0.790.780.76 query16 0.380.380.40 query17 1.001.011.01 query18 0.250.270.25 query19 1.871.781.78 query20 0.010.010.02 query21 15.41 0.550.56 query22 2.542.691.66 query23 17.44 0.820.75 query24 2.591.121.00 query25 0.440.200.13 query26 0.550.140.14 query27 0.060.060.06 query28 11.47 0.790.80 query29 12.65 3.213.22 query30 0.530.500.55 query31 2.780.340.35 query32 3.400.480.50 query33 3.233.273.22 query34 16.00 4.244.25 query35 4.274.204.23 query36 1.121.071.08 query37 0.070.050.05 query38 0.040.030.03 query39 0.020.020.02 query40 0.160.120.13 query41 0.070.010.01 query42 0.020.010.01 query43 0.020.010.02 Total cold run time: 105.97 s Total hot run time: 30.88 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](Nereids): persist constraint in table [doris]
doris-robot commented on PR #29767: URL: https://github.com/apache/doris/pull/29767#issuecomment-1893241680 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 972dee5251fb18c212a4a55e84656046e79dfe40 with default session variables Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 13.8 seconds inserted 1000 Rows, about 724K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](asyncwriter) rename is close done to is pending finish [doris]
yiguolei commented on PR #30021: URL: https://github.com/apache/doris/pull/30021#issuecomment-1893243597 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](profile)Support active_queries TVF [doris]
doris-robot commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893244499 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 8fac397f335a3d37ca14ce7a1962664220fb596e with default session variables Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 14.7 seconds inserted 1000 Rows, about 680K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](function) support ip function is_ipv4_compat, is_ipv4_mapped [doris]
doris-robot commented on PR #29954: URL: https://github.com/apache/doris/pull/29954#issuecomment-1893251956 TPC-H: Total hot run time: 40007 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ca37212107ae152e2025e01e04938e598ed74cc3, data reload: false -- Round 1 -- q1 17964 676357525752 q2 2044144 138 138 q3 10854 114511901145 q4 10495 799 854 799 q5 7851316232093162 q6 206 127 126 126 q7 921 497 502 497 q8 9258202020152015 q9 7332647664086408 q10 8270310430723072 q11 419 222 217 217 q12 364 204 206 204 q13 18116 344134333433 q14 240 225 217 217 q15 557 519 527 519 q16 443 416 388 388 q17 959 546 540 540 q18 7814700669596959 q19 1602135113361336 q20 548 317 291 291 q21 2862244525362445 q22 381 344 345 344 Total cold run time: 109500 ms Total hot run time: 40007 ms - Round 2, with runtime_filter_mode=off - q1 5870578756615661 q2 358 238 240 238 q3 3365327532213221 q4 2191207020412041 q5 6060594359055905 q6 212 126 122 122 q7 2425202520612025 q8 3626378537903785 q9 980722158 95169516 q10 7231372038323720 q11 606 466 444 444 q12 1155640 623 623 q13 17090 327232393239 q14 316 269 268 268 q15 581 510 513 510 q16 529 486 499 486 q17 4302205020212021 q18 9428920813092 9208 q19 13588 162816071607 q20 4594194519451945 q21 14580 576755845584 q22 1467573 594 573 Total cold run time: 109381 ms Total hot run time: 62742 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Job)Incorrect task query result of insert type [doris]
doris-robot commented on PR #30024: URL: https://github.com/apache/doris/pull/30024#issuecomment-1893255632 TPC-H: Total hot run time: 40196 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit cc7cbc03f6f307b2ef8da67ec3b9eb1ef7d97087, data reload: false -- Round 1 -- q1 17927 597857995799 q2 2052158 138 138 q3 10883 116111881161 q4 10825 798 804 798 q5 7934325832303230 q6 209 127 129 127 q7 930 536 502 502 q8 9719203920272027 q9 7953658565466546 q10 8249309730913091 q11 415 211 218 211 q12 359 190 194 190 q13 18116 347234083408 q14 249 220 218 218 q15 553 519 507 507 q16 439 398 393 393 q17 948 560 503 503 q18 7795710169826982 q19 1595139413651365 q20 579 302 314 302 q21 2920247123822382 q22 382 333 316 316 Total cold run time: 111031 ms Total hot run time: 40196 ms - Round 2, with runtime_filter_mode=off - q1 5978559156585591 q2 365 235 229 229 q3 3298322031223122 q4 2243202221432022 q5 6101597059865970 q6 206 123 127 123 q7 2446202720622027 q8 3664371937193719 q9 985023741 94109410 q10 5284380438933804 q11 609 471 454 454 q12 1164647 646 646 q13 17130 330032703270 q14 347 262 271 262 q15 593 509 511 509 q16 557 492 465 465 q17 6856212320932093 q18 9457948112244 9481 q19 12458 164816451645 q20 3802196919401940 q21 14842 573760375737 q22 1127615 650 615 Total cold run time: 108377 ms Total hot run time: 63134 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Nereids): optimize logical group expression in dphyp [doris]
github-actions[bot] commented on PR #3: URL: https://github.com/apache/doris/pull/3#issuecomment-1893256996 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Nereids): inferPredicate support InPredicate into Branch 2.0 [doris]
jackwener merged PR #30007: URL: https://github.com/apache/doris/pull/30007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.0 updated: [feature](Nereids): InferPredicates support In (#29458) (#30007)
This is an automated email from the ASF dual-hosted git repository.
jakevin pushed a commit to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.0 by this push:
new a24c0356b0e [feature](Nereids): InferPredicates support In (#29458)
(#30007)
a24c0356b0e is described below
commit a24c0356b0e8c4a17b10d82fb125c41778c262d8
Author: jakevin
AuthorDate: Tue Jan 16 16:21:03 2024 +0800
[feature](Nereids): InferPredicates support In (#29458) (#30007)
(cherry picked from commit 7a0734dbd60effa676d87bf5a5b7ca516e134d52)
---
.../nereids/rules/rewrite/InferPredicates.java | 11 +-
.../rules/rewrite/PredicatePropagation.java| 179 +
.../nereids/rules/rewrite/PullUpPredicates.java| 4 +-
.../nereids/trees/expressions/InPredicate.java | 34 ++--
.../nereids/rules/rewrite/InferPredicatesTest.java | 60 ---
.../rules/rewrite/PredicatePropagationTest.java| 51 ++
.../data/nereids_p0/hint/fix_leading.out | 2 +-
.../infer_predicate/infer_predicate.groovy | 2 +-
8 files changed, 220 insertions(+), 123 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/InferPredicates.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/InferPredicates.java
index 3c4593df54c..36236c3db8d 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/InferPredicates.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/InferPredicates.java
@@ -27,7 +27,6 @@ import
org.apache.doris.nereids.trees.plans.visitor.DefaultPlanRewriter;
import org.apache.doris.nereids.util.ExpressionUtils;
import org.apache.doris.nereids.util.PlanUtils;
-import com.google.common.collect.ImmutableList;
import com.google.common.collect.ImmutableSet;
import com.google.common.collect.Sets;
@@ -37,6 +36,7 @@ import java.util.stream.Collectors;
/**
* infer additional predicates for `LogicalFilter` and `LogicalJoin`.
+ *
* The logic is as follows:
* 1. poll up bottom predicate then infer additional predicates
* for example:
@@ -49,9 +49,9 @@ import java.util.stream.Collectors;
* select * from (select * from t1 where t1.id = 1) t join t2 on t.id =
t2.id and t2.id = 1
* 2. put these predicates into `otherJoinConjuncts` , these predicates are
processed in the next
* round of predicate push-down
+ *
*/
public class InferPredicates extends DefaultPlanRewriter
implements CustomRewriter {
-private final PredicatePropagation propagation = new
PredicatePropagation();
private final PullUpPredicates pollUpPredicates = new PullUpPredicates();
@Override
@@ -62,6 +62,9 @@ public class InferPredicates extends
DefaultPlanRewriter implements
@Override
public Plan visitLogicalJoin(LogicalJoin
join, JobContext context) {
join = visitChildren(this, join, context);
+if (join.isMarkJoin()) {
+return join;
+}
Plan left = join.left();
Plan right = join.right();
Set expressions = getAllExpressions(left, right,
join.getOnClauseCondition());
@@ -86,7 +89,7 @@ public class InferPredicates extends
DefaultPlanRewriter implements
break;
}
if (left != join.left() || right != join.right()) {
-return join.withChildren(ImmutableList.of(left, right));
+return join.withChildren(left, right);
} else {
return join;
}
@@ -109,7 +112,7 @@ public class InferPredicates extends
DefaultPlanRewriter implements
Set baseExpressions = pullUpPredicates(left);
baseExpressions.addAll(pullUpPredicates(right));
condition.ifPresent(on ->
baseExpressions.addAll(ExpressionUtils.extractConjunction(on)));
-baseExpressions.addAll(propagation.infer(baseExpressions));
+baseExpressions.addAll(PredicatePropagation.infer(baseExpressions));
return baseExpressions;
}
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/PredicatePropagation.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/PredicatePropagation.java
index 2317da427ea..aa520362a77 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/PredicatePropagation.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/PredicatePropagation.java
@@ -24,6 +24,7 @@ import org.apache.doris.nereids.trees.expressions.Cast;
import org.apache.doris.nereids.trees.expressions.ComparisonPredicate;
import org.apache.doris.nereids.trees.expressions.EqualTo;
import org.apache.doris.nereids.trees.expressions.Expression;
+import org.apache.doris.nereids.trees.expressions.InPredicate;
import org.apache.doris.nereids.trees.expressions.SlotReference;
import org.apache.doris.nereids.trees.expressions.literal.IntegerLikeLiteral;
import org.apach
Re: [PR] [feature](Nereids): optimize logical group expression in dphyp [doris]
seawinde commented on code in PR #3:
URL: https://github.com/apache/doris/pull/3#discussion_r1453071348
##
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/RuleSet.java:
##
@@ -243,6 +239,11 @@ public class RuleSet {
.add(MaterializedViewFilterProjectAggregateRule.INSTANCE)
.build();
+public static final List DPHYP_REORDER_RULES =
ImmutableList.builder()
+.addAll(MATERIALIZED_VIEW_RULES)
Review Comment:
this maybe optmized later, MATERIALIZED_VIEW_RULES are also added by outside
at `org.apache.doris.nereids.jobs.cascades.OptimizeGroupExpressionJob#execute`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](function) support ip function is_ipv4_compat, is_ipv4_mapped [doris]
doris-robot commented on PR #29954: URL: https://github.com/apache/doris/pull/29954#issuecomment-1893268187 TPC-DS: Total hot run time: 178773 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ca37212107ae152e2025e01e04938e598ed74cc3, data reload: false query1 935 335 335 335 query2 6722185718891857 query3 6710204 211 204 query4 32448 22309 22177 22177 query5 6950592 537 537 query6 262 173 187 173 query7 4619274 274 274 query8 242 197 201 197 query9 9160273428472734 query10 490 257 232 232 query11 16823 15318 15359 15318 query12 126 75 70 70 query13 1698384 388 384 query14 11370 731872427242 query15 212 181 195 181 query16 4638265 246 246 query17 998 493 468 468 query18 1807268 262 262 query19 188 148 143 143 query20 81 76 77 76 query21 192 131 140 131 query22 5030448945174489 query23 31729 31056 31048 31048 query24 12463 283527932793 query25 568 323 332 323 query26 1818158 158 158 query27 3243286 282 282 query28 7271186918491849 query29 2260691 663 663 query30 284 138 140 138 query31 923 770 761 761 query32 76 63 62 62 query33 728 240 239 239 query34 1177454 472 454 query35 897 769 788 769 query36 1317127013201270 query37 104 71 72 71 query38 3417334132633263 query39 1322130312701270 query40 339 98 92 92 query41 40 35 36 35 query42 108 90 96 90 query43 560 481 506 481 query44 1049703 703 703 query45 209 188 180 180 query46 1069634 636 634 query47 1685163016121612 query48 413 326 333 326 query49 1263310 320 310 query50 710 308 305 305 query51 5330523651845184 query52 99 97 96 96 query53 358 281 287 281 query54 887 452 464 452 query55 92 96 94 94 query56 207 199 198 198 query57 1004976 968 968 query58 210 199 188 188 query59 3058279527322732 query60 246 213 208 208 query61 90 85 81 81 query62 683 418 411 411 query63 297 295 284 284 query64 6265168416781678 query65 3362327332593259 query66 1477334 317 317 query67 16027 15283 15291 15283 query68 12044 515 523 515 query69 640 338 333 333 query70 1706155014641464 query71 542 243 254 243 query72 4801282929422829 query73 2930328 312 312 query74 7302642064856420 query75 5113230623842306 query76 6300980 987 980 query77 648 276 263 263 query78 9169888985768576 query79 1651495 510 495 query80 548 352 345 345 query81 456 207 208 207 query82 208 92 89 89 query83 149 121 117 117 query84 274 75 77 75 query85 1058337 317 317 query86 412 389 377 377 query87 3548340834293408 query88 3301219022052190 query89 452 401 407 401 query90 2034201 199 199 query91 155 125 125 125 query92 63 50 58 50 query93 1848445 423 423 query94 1174182 173 173 query95 532 491 482 482 query96 629 310 311 310 query97 4276417641764176 query98 206 194 203 194 query99 1028754 764 754 Total cold run time: 303632 ms Total hot run time: 178773 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [fix](Nereids) remove useless substr of string like type cast [doris]
morrySnow commented on PR #29997: URL: https://github.com/apache/doris/pull/29997#issuecomment-1893269298 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](profile)Support active_queries TVF [doris]
doris-robot commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893269480 TeamCity be ut coverage result: Function Coverage: 36.66% (8644/23579) Line Coverage: 28.68% (70438/245575) Region Coverage: 27.61% (36410/131878) Branch Coverage: 24.33% (18628/76576) Coverage Report: http://coverage.selectdb-in.cc/coverage/8fac397f335a3d37ca14ce7a1962664220fb596e_8fac397f335a3d37ca14ce7a1962664220fb596e/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Feature](materialized-view) support match function with alias in materialized-view [doris]
BiteThet opened a new pull request, #30025: URL: https://github.com/apache/doris/pull/30025 ## Proposed changes support match function with alias in materialized-view ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](materialized-view) support match function with alias in materialized-view [doris]
BiteThet commented on PR #30025: URL: https://github.com/apache/doris/pull/30025#issuecomment-1893270269 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Job)Incorrect task query result of insert type [doris]
doris-robot commented on PR #30024: URL: https://github.com/apache/doris/pull/30024#issuecomment-1893271943 TPC-DS: Total hot run time: 180391 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit cc7cbc03f6f307b2ef8da67ec3b9eb1ef7d97087, data reload: false query1 947 352 336 336 query2 6702196819471947 query3 6723215 207 207 query4 33175 22557 22182 22182 query5 6956617 551 551 query6 278 193 192 192 query7 4622291 278 278 query8 252 202 201 201 query9 9146277428802774 query10 478 251 244 244 query11 17019 15414 15292 15292 query12 124 76 82 76 query13 1700394 396 394 query14 11398 745576207455 query15 211 186 184 184 query16 4623255 248 248 query17 1008504 493 493 query18 1810273 268 268 query19 195 155 147 147 query20 83 81 76 76 query21 197 138 127 127 query22 4938474346964696 query23 32105 31279 31264 31264 query24 12589 287828482848 query25 573 333 337 333 query26 1673163 166 163 query27 3229282 285 282 query28 7372185418461846 query29 1792726 700 700 query30 281 148 141 141 query31 936 769 771 769 query32 78 64 64 64 query33 705 257 263 257 query34 1130482 484 482 query35 892 765 798 765 query36 1465117713241177 query37 100 70 69 69 query38 3388328833343288 query39 1338130012871287 query40 338 98 95 95 query41 39 37 36 36 query42 101 96 101 96 query43 575 539 525 525 query44 1087712 712 712 query45 212 189 186 186 query46 1069672 681 672 query47 1724160616191606 query48 406 326 327 326 query49 1204317 324 317 query50 704 330 326 326 query51 5383529753035297 query52 105 92 102 92 query53 368 284 300 284 query54 915 474 478 474 query55 95 91 86 86 query56 215 206 199 199 query57 1045939 941 939 query58 219 194 200 194 query59 3007292828292829 query60 245 217 215 215 query61 88 86 90 86 query62 701 401 407 401 query63 313 308 302 302 query64 6235167516991675 query65 3390329233053292 query66 1254355 325 325 query67 15794 15144 15243 15144 query68 12202 551 552 551 query69 660 348 348 348 query70 1737158415531553 query71 546 233 257 233 query72 4949286428422842 query73 2951323 311 311 query74 7192647865816478 query75 5274235823082308 query76 6235103310491033 query77 692 287 271 271 query78 9440879787508750 query79 1047522 527 522 query80 559 336 368 336 query81 449 212 209 209 query82 211 96 90 90 query83 147 131 126 126 query84 281 74 76 74 query85 1046366 334 334 query86 391 372 381 372 query87 3593337233503350 query88 3100220622112206 query89 460 400 386 386 query90 2026206 202 202 query91 156 127 125 125 query92 65 60 55 55 query93 1419428 432 428 query94 1183192 188 188 query95 521 486 491 486 query96 625 322 318 318 query97 4300416741574157 query98 224 199 190 190 query99 1082742 725 725 Total cold run time: 303825 ms Total hot run time: 180391 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the
Re: [PR] [feature](function) support ip function is_ipv4_compat, is_ipv4_mapped [doris]
doris-robot commented on PR #29954: URL: https://github.com/apache/doris/pull/29954#issuecomment-1893275311 TeamCity be ut coverage result: Function Coverage: 36.66% (8648/23591) Line Coverage: 28.69% (70453/245602) Region Coverage: 27.61% (36421/131898) Branch Coverage: 24.32% (18628/76594) Coverage Report: http://coverage.selectdb-in.cc/coverage/ca37212107ae152e2025e01e04938e598ed74cc3_ca37212107ae152e2025e01e04938e598ed74cc3/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](function) support ip function is_ipv4_compat, is_ipv4_mapped [doris]
doris-robot commented on PR #29954: URL: https://github.com/apache/doris/pull/29954#issuecomment-1893275690 ClickBench: Total hot run time: 31.44 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ca37212107ae152e2025e01e04938e598ed74cc3, data reload: false query1 0.060.060.06 query2 0.070.030.02 query3 0.260.120.11 query4 1.770.130.12 query5 0.540.520.53 query6 1.280.640.62 query7 0.020.010.02 query8 0.040.030.02 query9 0.540.520.50 query10 0.550.570.56 query11 0.120.090.09 query12 0.110.100.08 query13 0.600.600.59 query14 0.760.810.78 query15 0.790.780.77 query16 0.360.380.37 query17 1.021.001.02 query18 0.250.270.25 query19 1.811.791.71 query20 0.020.010.01 query21 15.40 0.550.58 query22 2.412.882.03 query23 17.20 0.740.78 query24 2.351.171.57 query25 0.440.280.17 query26 0.440.150.14 query27 0.060.050.06 query28 11.08 0.830.80 query29 12.57 3.243.20 query30 0.550.500.45 query31 2.790.350.35 query32 3.380.480.48 query33 3.243.233.23 query34 15.82 4.274.27 query35 4.224.264.26 query36 1.121.071.08 query37 0.060.060.06 query38 0.040.030.03 query39 0.020.020.02 query40 0.170.130.13 query41 0.070.020.02 query42 0.020.020.01 query43 0.020.020.02 Total cold run time: 104.44 s Total hot run time: 31.44 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Nereids): optimize logical group expression in dphyp [doris]
github-actions[bot] commented on PR #3: URL: https://github.com/apache/doris/pull/3#issuecomment-1893275903 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](function) support ip function is_ipv4_compat, is_ipv4_mapped [doris]
superdiaodiao commented on PR #29954: URL: https://github.com/apache/doris/pull/29954#issuecomment-1893276835 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Job)Incorrect task query result of insert type [doris]
doris-robot commented on PR #30024: URL: https://github.com/apache/doris/pull/30024#issuecomment-1893279728 ClickBench: Total hot run time: 30.62 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit cc7cbc03f6f307b2ef8da67ec3b9eb1ef7d97087, data reload: false query1 0.060.060.06 query2 0.060.020.03 query3 0.250.110.11 query4 1.790.120.12 query5 0.550.520.53 query6 1.320.660.64 query7 0.020.010.01 query8 0.040.030.03 query9 0.540.520.49 query10 0.560.560.56 query11 0.120.090.09 query12 0.120.090.09 query13 0.600.610.60 query14 0.780.780.79 query15 0.790.790.76 query16 0.390.400.40 query17 1.031.051.04 query18 0.250.260.27 query19 1.861.781.84 query20 0.020.010.01 query21 15.44 0.590.58 query22 2.972.801.80 query23 17.44 0.800.82 query24 2.621.160.38 query25 0.330.200.20 query26 0.520.150.14 query27 0.060.060.05 query28 11.92 0.790.80 query29 12.74 3.323.12 query30 0.570.540.53 query31 2.780.340.37 query32 3.390.480.49 query33 3.253.263.25 query34 15.86 4.304.21 query35 4.254.234.28 query36 1.131.081.08 query37 0.060.050.05 query38 0.040.030.04 query39 0.020.020.02 query40 0.150.130.14 query41 0.070.010.02 query42 0.030.010.01 query43 0.030.020.02 Total cold run time: 106.82 s Total hot run time: 30.62 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Bug] restore error Invalid method name: 'fileSize' [doris]
d378971067 closed issue #24742: [Bug] restore error Invalid method name: 'fileSize' URL: https://github.com/apache/doris/issues/24742 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](merge-cloud) Add create cloud table [doris]
luwei16 commented on code in PR #30001: URL: https://github.com/apache/doris/pull/30001#discussion_r1452868060 ## fe/fe-core/src/main/java/org/apache/doris/cloud/datasource/CloudInternalCatalog.java: ## @@ -17,13 +17,495 @@ package org.apache.doris.cloud.datasource; Review Comment: The auto bucket on cloud is different from doris -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](merge-cloud) Add create cloud table [doris]
github-actions[bot] commented on PR #30001: URL: https://github.com/apache/doris/pull/30001#issuecomment-1893283049 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Fix](Job)Incorrect task query result of insert type [doris]
doris-robot commented on PR #30024: URL: https://github.com/apache/doris/pull/30024#issuecomment-1893283962 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit cc7cbc03f6f307b2ef8da67ec3b9eb1ef7d97087 with default session variables Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s Insert into select: 14.7 seconds inserted 1000 Rows, about 680K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](multi-table-load) fix multi table load can not finish [doris]
liaoxin01 commented on code in PR #29957:
URL: https://github.com/apache/doris/pull/29957#discussion_r1453089406
##
be/src/io/fs/multi_table_pipe.h:
##
@@ -46,7 +46,13 @@ class MultiTablePipe : public KafkaConsumerPipe {
// request and execute plans for unplanned pipes
Status request_and_exec_plans();
-void set_consume_finished() { _consume_finished.store(true,
std::memory_order_release); }
+void set_consume_finished() {
+--_inflight_cnt;
Review Comment:
why need do `--_inflight_cnt` here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](multi-table-load) fix multi table load can not finish [doris]
liaoxin01 commented on code in PR #29957:
URL: https://github.com/apache/doris/pull/29957#discussion_r1453089406
##
be/src/io/fs/multi_table_pipe.h:
##
@@ -46,7 +46,13 @@ class MultiTablePipe : public KafkaConsumerPipe {
// request and execute plans for unplanned pipes
Status request_and_exec_plans();
-void set_consume_finished() { _consume_finished.store(true,
std::memory_order_release); }
+void set_consume_finished() {
+--_inflight_cnt;
Review Comment:
why need do `--_inflight_cnt` here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [refactor](asyncwriter) rename is close done to is pending finish [doris]
doris-robot commented on PR #30021: URL: https://github.com/apache/doris/pull/30021#issuecomment-1893287045 TeamCity be ut coverage result: Function Coverage: 36.67% (8645/23573) Line Coverage: 28.69% (70454/245529) Region Coverage: 27.62% (36420/131864) Branch Coverage: 24.33% (18629/76566) Coverage Report: http://coverage.selectdb-in.cc/coverage/a41cce137fbfb605c65ef3824f6838595b41ec63_a41cce137fbfb605c65ef3824f6838595b41ec63/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](profile)Support active_queries TVF [doris]
wangbo commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893293373 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [fix](Nereids): find hash condition after infer predicate [doris]
jackwener opened a new pull request, #30026: URL: https://github.com/apache/doris/pull/30026 ## Proposed changes find hash condition after infer predicate ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](function) support ip function is_ipv4_compat, is_ipv4_mapped [doris]
doris-robot commented on PR #29954: URL: https://github.com/apache/doris/pull/29954#issuecomment-1893305826 TPC-H: Total hot run time: 39589 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 69036251072bca28b0da84a643ef33b9300a8346, data reload: false -- Round 1 -- q1 17934 636456655665 q2 2039145 134 134 q3 10688 118311391139 q4 10255 800 857 800 q5 7790311632323116 q6 204 123 125 123 q7 899 497 489 489 q8 9247198720091987 q9 7327643363836383 q10 8251310131373101 q11 417 203 211 203 q12 360 191 196 191 q13 18109 343933813381 q14 250 215 208 208 q15 569 520 505 505 q16 432 401 383 383 q17 943 522 513 513 q18 7870723168626862 q19 1591134013261326 q20 575 314 293 293 q21 2876249624652465 q22 382 322 330 322 Total cold run time: 109008 ms Total hot run time: 39589 ms - Round 2, with runtime_filter_mode=off - q1 5879564656245624 q2 349 220 227 220 q3 3348309031323090 q4 2234211619851985 q5 6140596759845967 q6 208 116 122 116 q7 2375203819891989 q8 3614367036763670 q9 974724053 95509550 q10 9964383738323832 q11 682 462 457 457 q12 1180650 653 650 q13 17144 331632763276 q14 367 262 276 262 q15 585 510 510 510 q16 550 492 487 487 q17 9284200220072002 q18 9637946912046 9469 q19 13538 162015961596 q20 3520194719291929 q21 14847 569657795696 q22 1072596 626 596 Total cold run time: 116264 ms Total hot run time: 62973 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids): find hash condition after infer predicate [doris]
jackwener commented on PR #30026: URL: https://github.com/apache/doris/pull/30026#issuecomment-1893304733 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](merge-cloud) Add create cloud table [doris]
yujun777 commented on code in PR #30001: URL: https://github.com/apache/doris/pull/30001#discussion_r1453106834 ## fe/fe-core/src/main/java/org/apache/doris/cloud/datasource/CloudInternalCatalog.java: ## @@ -17,13 +17,495 @@ package org.apache.doris.cloud.datasource; Review Comment: ok， 后面的小pr再挨个修 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](jobs)fix create task in insert job [doris]
morningman merged PR #30011: URL: https://github.com/apache/doris/pull/30011 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](jobs)fix create task int job (#30011)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 5bb5dc7388a [fix](jobs)fix create task int job (#30011)
5bb5dc7388a is described below
commit 5bb5dc7388aec140f5e8f6e65b6d68cd617fa7a0
Author: slothever <18522955+w...@users.noreply.github.com>
AuthorDate: Tue Jan 16 17:02:00 2024 +0800
[fix](jobs)fix create task int job (#30011)
---
.../java/org/apache/doris/job/extensions/insert/InsertJob.java | 7 +--
1 file changed, 5 insertions(+), 2 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/job/extensions/insert/InsertJob.java
b/fe/fe-core/src/main/java/org/apache/doris/job/extensions/insert/InsertJob.java
index 44cc63ee999..ce918c426f8 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/job/extensions/insert/InsertJob.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/job/extensions/insert/InsertJob.java
@@ -244,9 +244,11 @@ public class InsertJob extends AbstractJob> impl
@Override
public List createTasks(TaskType taskType, Map
taskContext) {
+List newTasks = new ArrayList<>();
if (plans.isEmpty()) {
InsertTask task = new InsertTask(labelName, getCurrentDbName(),
getExecuteSql(), getCreateUser());
idToTasks.put(task.getTaskId(), task);
+newTasks.add(task);
recordTask(task.getTaskId());
} else {
// use for load stmt
@@ -256,11 +258,12 @@ public class InsertJob extends AbstractJob> impl
}
InsertTask task = new InsertTask(logicalPlan, ctx,
stmtExecutor, loadStatistic);
idToTasks.put(task.getTaskId(), task);
+newTasks.add(task);
recordTask(task.getTaskId());
}
}
-initTasks(idToTasks.values(), taskType);
-return new ArrayList<>(idToTasks.values());
+initTasks(newTasks, taskType);
+return new ArrayList<>(newTasks);
}
public void recordTask(long id) {
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](function) support ip function is_ipv4_compat, is_ipv4_mapped [doris]
doris-robot commented on PR #29954: URL: https://github.com/apache/doris/pull/29954#issuecomment-1893326266 TeamCity be ut coverage result: Function Coverage: 36.66% (8648/23591) Line Coverage: 28.68% (70449/245604) Region Coverage: 27.60% (36409/131900) Branch Coverage: 24.31% (18623/76596) Coverage Report: http://coverage.selectdb-in.cc/coverage/69036251072bca28b0da84a643ef33b9300a8346_69036251072bca28b0da84a643ef33b9300a8346/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](profile)Support active_queries TVF [doris]
wangbo commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893328250 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](function) support ip function is_ipv4_compat, is_ipv4_mapped [doris]
doris-robot commented on PR #29954: URL: https://github.com/apache/doris/pull/29954#issuecomment-1893327412 TPC-DS: Total hot run time: 178817 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 69036251072bca28b0da84a643ef33b9300a8346, data reload: false query1 944 333 329 329 query2 6719213019131913 query3 6715209 210 209 query4 36128 22106 22107 22106 query5 6950542 585 542 query6 260 181 182 181 query7 4610278 273 273 query8 231 224 196 196 query9 9174280427342734 query10 607 251 243 243 query11 16444 15414 15223 15223 query12 126 75 74 74 query13 1700376 392 376 query14 11194 754374637463 query15 211 188 196 188 query16 4621250 244 244 query17 1015499 479 479 query18 1803272 261 261 query19 190 151 149 149 query20 80 80 74 74 query21 193 125 122 122 query22 4993481745994599 query23 32060 31097 31091 31091 query24 12690 288928182818 query25 569 327 335 327 query26 1866149 148 148 query27 3310278 276 276 query28 7686186918431843 query29 2237726 693 693 query30 284 140 137 137 query31 944 757 766 757 query32 80 63 62 62 query33 720 252 249 249 query34 1204441 467 441 query35 897 781 794 781 query36 1344124511711171 query37 183 70 71 70 query38 3429329132693269 query39 1342126712661266 query40 344 94 89 89 query41 42 34 36 34 query42 104 94 98 94 query43 570 531 561 531 query44 1122701 724 701 query45 198 191 183 183 query46 1074642 638 638 query47 1707161016241610 query48 412 339 331 331 query49 1249306 310 306 query50 720 324 313 313 query51 5343521751905190 query52 102 95 103 95 query53 353 273 295 273 query54 898 455 477 455 query55 104 86 93 86 query56 202 201 197 197 query57 1070970 942 942 query58 212 188 205 188 query59 2986288226782678 query60 243 209 228 209 query61 82 81 83 81 query62 691 393 415 393 query63 322 294 297 294 query64 6253169516801680 query65 3357327832713271 query66 1456339 322 322 query67 15686 15280 15541 15280 query68 11871 513 516 513 query69 628 336 336 336 query70 1696152914911491 query71 486 234 245 234 query72 5178284528092809 query73 2764312 321 312 query74 6993646163696369 query75 4843237823162316 query76 5843964 1055964 query77 659 274 269 269 query78 9071880885348534 query79 3732512 505 505 query80 568 330 349 330 query81 458 203 208 203 query82 238 94 90 90 query83 144 124 117 117 query84 284 75 79 75 query85 1060332 326 326 query86 405 378 372 372 query87 3547336533423342 query88 3606219322012193 query89 446 381 399 381 query90 1991208 203 203 query91 166 122 122 122 query92 67 51 54 51 query93 2583456 448 448 query94 1159184 176 176 query95 533 483 475 475 query96 629 314 307 307 query97 4303417842204178 query98 200 199 179 179 query99 1049756 761 756 Total cold run time: 309855 ms Total hot run time: 178817 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
[I] [Bug] java udf load fail log when be is started [doris]
Level1Accelerator opened a new issue, #30027: URL: https://github.com/apache/doris/issues/30027 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version 1.2.7.1 ### What's Wrong? 6620 user_function_cache.cpp:195] load a library failed, dir=/app/doris/be/lib/udf/83, file=25683.d29c7e4e3b099b2d609ef4d67724caf4.doris-udf-jar-with-dependencies.jar no other error message,i do not know why load java udf jar fail。the udf jar is exsit in /app/doris/be/lib/udf/83 ### What You Expected? load java udf library success ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [chore](removelogs) remove debug query timeout logs [doris]
yiguolei merged PR #30006: URL: https://github.com/apache/doris/pull/30006 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [chore](removelogs) remove debug query timeout logs (#30006)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new d9b3b591814 [chore](removelogs) remove debug query timeout logs
(#30006)
d9b3b591814 is described below
commit d9b3b5918146a877879008c98d8b1d64092d0c65
Author: yiguolei <676222...@qq.com>
AuthorDate: Tue Jan 16 17:06:59 2024 +0800
[chore](removelogs) remove debug query timeout logs (#30006)
-
Co-authored-by: yiguolei
---
be/src/vec/exec/scan/pip_scanner_context.h | 4
be/src/vec/exec/scan/scanner_context.cpp | 3 ---
be/src/vec/exec/scan/scanner_scheduler.cpp | 6 --
be/src/vec/exec/scan/vscan_node.cpp| 5 -
regression-test/pipeline/p0/conf/be.conf | 2 +-
5 files changed, 1 insertion(+), 19 deletions(-)
diff --git a/be/src/vec/exec/scan/pip_scanner_context.h
b/be/src/vec/exec/scan/pip_scanner_context.h
index 1afe3b599e5..c2490a5e0d0 100644
--- a/be/src/vec/exec/scan/pip_scanner_context.h
+++ b/be/src/vec/exec/scan/pip_scanner_context.h
@@ -48,7 +48,6 @@ public:
}
if (!status().ok()) {
-LOG(INFO) << " status not ok " << debug_string();
return _process_status;
}
}
@@ -61,12 +60,10 @@ public:
// if done, then eos is returned to indicate that the scan
operator finished.
if (_blocks_queues[id].empty()) {
*eos = done();
-LOG(INFO) << " queue is empty and ctx finished " <<
debug_string();
return Status::OK();
}
if (_process_status.is()) {
*eos = true;
-LOG(INFO) << " process status is cancelled " <<
debug_string();
return Status::OK();
}
*block = std::move(_blocks_queues[id].front());
@@ -85,7 +82,6 @@ public:
}
if (_blocks_queues[id].empty()) {
-LOG(INFO) << " block queue is empty, try to resched ctx "
<< debug_string();
this->reschedule_scanner_ctx();
}
}
diff --git a/be/src/vec/exec/scan/scanner_context.cpp
b/be/src/vec/exec/scan/scanner_context.cpp
index 3b1cecd7ac2..0b19f389920 100644
--- a/be/src/vec/exec/scan/scanner_context.cpp
+++ b/be/src/vec/exec/scan/scanner_context.cpp
@@ -482,7 +482,6 @@ void
ScannerContext::push_back_scanner_and_reschedule(std::shared_ptr_scanner->need_to_close()) {
@@ -504,8 +503,6 @@ void
ScannerContext::push_back_scanner_and_reschedule(std::shared_ptr ctx) {
-LOG(INFO) << " submit scanner ctx " << ctx->debug_string();
if (ctx->done()) {
-LOG(INFO) << " ctx is done, not submit" << ctx->debug_string();
return Status::EndOfFile("ScannerContext is done");
}
ctx->queue_idx = (_queue_idx++ % QUEUE_NUM);
if (!_pending_queues[ctx->queue_idx]->blocking_put(ctx)) {
-LOG(INFO) << " put to queue failed, not submit" <<
ctx->debug_string();
return Status::InternalError("failed to submit scanner context to
scheduler");
}
return Status::OK();
@@ -181,21 +178,18 @@ void
ScannerScheduler::_schedule_scanners(std::shared_ptr ctx) {
<< " maybe finished";
return;
}
-LOG(INFO) << " scheduled, query " << ctx->debug_string();
MonotonicStopWatch watch;
watch.reset();
watch.start();
ctx->incr_num_ctx_scheduling(1);
if (ctx->done()) {
-LOG(INFO) << " ctx done, " << ctx->debug_string();
return;
}
std::list> this_run;
ctx->get_next_batch_of_scanners(&this_run);
if (this_run.empty()) {
-LOG(INFO) << " run is empty, skip, " << ctx->debug_string();
// There will be 2 cases when this_run is empty:
// 1. The blocks queue reaches limit.
// The consumer will continue scheduling the ctx.
diff --git a/be/src/vec/exec/scan/vscan_node.cpp
b/be/src/vec/exec/scan/vscan_node.cpp
index cf52341b34f..78a15bbe404 100644
--- a/be/src/vec/exec/scan/vscan_node.cpp
+++ b/be/src/vec/exec/scan/vscan_node.cpp
@@ -197,8 +197,6 @@ Status VScanNode::alloc_resource(RuntimeState* state) {
if (_scanner_ctx) {
DCHECK(!_eos && _num_scanners->value() > 0);
RETURN_IF_ERROR(_scanner_ctx->init());
-LOG(INFO) << " instance " <<
print_id(state->fragment_instance_id())
- << " submit scanner ctx " <<
_scanner_ctx->debug_string();
RETURN_IF_ERROR(_state->exec_env()->scanner_scheduler()->submit(_scanner_ctx));
}
if (_shared_scan_opt) {
@@ -221,9 +219,6 @@ Status VScanNode::alloc_resource(RuntimeState* state) {
: Status::OK());
if (_scanner_ctx) {
RETURN_I
Re: [I] [Bug] java udf load fail log when be is started [doris]
Level1Accelerator commented on issue #30027: URL: https://github.com/apache/doris/issues/30027#issuecomment-1893331422  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](arm) Support auto-SIMD on arm and refactor compilation docs [doris]
zclllyybb commented on PR #29956: URL: https://github.com/apache/doris/pull/29956#issuecomment-189458 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) struct type coercion call wrong api [doris]
github-actions[bot] commented on PR #30018: URL: https://github.com/apache/doris/pull/30018#issuecomment-189653 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) struct type coercion call wrong api [doris]
github-actions[bot] commented on PR #30018: URL: https://github.com/apache/doris/pull/30018#issuecomment-189708 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [improvement](catalog) Change the push-down parameters of the predicate function of the table query SQL into variables [doris]
zy-kkk opened a new pull request, #30028: URL: https://github.com/apache/doris/pull/30028 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](catalog) Change the push-down parameters of the predicate function of the table query SQL into variables [doris]
zy-kkk commented on PR #30028: URL: https://github.com/apache/doris/pull/30028#issuecomment-189955 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](function) support ip function is_ipv4_compat, is_ipv4_mapped [doris]
doris-robot commented on PR #29954: URL: https://github.com/apache/doris/pull/29954#issuecomment-1893336252 ClickBench: Total hot run time: 30.93 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 69036251072bca28b0da84a643ef33b9300a8346, data reload: false query1 0.060.050.05 query2 0.060.020.02 query3 0.250.130.12 query4 1.760.120.12 query5 0.540.530.53 query6 1.340.620.65 query7 0.020.010.02 query8 0.040.030.02 query9 0.530.510.48 query10 0.560.560.56 query11 0.120.080.08 query12 0.110.090.08 query13 0.610.590.60 query14 0.790.780.80 query15 0.790.780.77 query16 0.370.390.39 query17 1.001.011.05 query18 0.230.260.25 query19 1.881.811.82 query20 0.010.010.01 query21 15.43 0.580.60 query22 2.882.381.93 query23 17.53 0.740.75 query24 2.280.970.84 query25 0.420.230.15 query26 0.450.150.13 query27 0.040.040.07 query28 12.02 0.810.80 query29 12.59 3.153.17 query30 0.530.490.50 query31 2.780.350.37 query32 3.370.470.46 query33 3.233.263.20 query34 15.76 4.234.22 query35 4.264.224.25 query36 1.101.091.08 query37 0.070.050.05 query38 0.030.020.02 query39 0.020.010.01 query40 0.160.120.13 query41 0.070.020.02 query42 0.020.010.02 query43 0.020.020.02 Total cold run time: 106.13 s Total hot run time: 30.93 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [debug](don't merge) test memtable on sink node [doris]
kaijchen commented on PR #29115: URL: https://github.com/apache/doris/pull/29115#issuecomment-1893335449 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids) struct type coercion call wrong api [doris]
morrySnow merged PR #30018: URL: https://github.com/apache/doris/pull/30018 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [fix](Nereids) struct type coercion call wrong api (#30018)
This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new ff8e756fbbe [fix](Nereids) struct type coercion call wrong api (#30018)
ff8e756fbbe is described below
commit ff8e756fbbe7e9c63a905e6060497a381d2fc119
Author: morrySnow <101034200+morrys...@users.noreply.github.com>
AuthorDate: Tue Jan 16 17:10:54 2024 +0800
[fix](Nereids) struct type coercion call wrong api (#30018)
---
.../main/java/org/apache/doris/nereids/util/TypeCoercionUtils.java| 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/util/TypeCoercionUtils.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/util/TypeCoercionUtils.java
index 63a6a552f6d..185bcc055b3 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/util/TypeCoercionUtils.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/util/TypeCoercionUtils.java
@@ -1120,7 +1120,7 @@ public class TypeCoercionUtils {
}
List newFields = Lists.newArrayList();
for (int i = 0; i < leftFields.size(); i++) {
-Optional newDataType =
findCommonComplexTypeForComparison(leftFields.get(i).getDataType(),
+Optional newDataType =
findWiderTypeForTwoForComparison(leftFields.get(i).getDataType(),
rightFields.get(i).getDataType(), intStringToString);
if (newDataType.isPresent()) {
newFields.add(leftFields.get(i).withDataType(newDataType.get()));
@@ -1348,7 +1348,7 @@ public class TypeCoercionUtils {
}
List newFields = Lists.newArrayList();
for (int i = 0; i < leftFields.size(); i++) {
-Optional newDataType =
findCommonComplexTypeForCaseWhen(leftFields.get(i).getDataType(),
+Optional newDataType =
findWiderTypeForTwoForCaseWhen(leftFields.get(i).getDataType(),
rightFields.get(i).getDataType());
if (newDataType.isPresent()) {
newFields.add(leftFields.get(i).withDataType(newDataType.get()));
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] 0116 perf required [doris]
hello-stephen commented on PR #30020: URL: https://github.com/apache/doris/pull/30020#issuecomment-1893338399 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](function) support ip function is_ipv4_compat, is_ipv4_mapped [doris]
doris-robot commented on PR #29954: URL: https://github.com/apache/doris/pull/29954#issuecomment-1893341080 Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' ``` Load test result on commit 69036251072bca28b0da84a643ef33b9300a8346 with default session variables Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s Insert into select: 14.7 seconds inserted 1000 Rows, about 680K ops/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](arm) Support auto-SIMD on arm and refactor compilation docs [doris]
github-actions[bot] commented on PR #29956: URL: https://github.com/apache/doris/pull/29956#issuecomment-1893343248 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [DNM](Nereids) test disable fallback [doris]
morrySnow commented on PR #25344: URL: https://github.com/apache/doris/pull/25344#issuecomment-1893344255 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](profile)Support active_queries TVF [doris]
github-actions[bot] commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893344460 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](profile)Support active_queries TVF [doris]
github-actions[bot] commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893344529 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](decimal) fix wrong decimal overflow of cast caused by uninitialized nested column of null value [doris]
yiguolei merged PR #29960: URL: https://github.com/apache/doris/pull/29960 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (ff8e756fbbe -> 0e140a63de6)
This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from ff8e756fbbe [fix](Nereids) struct type coercion call wrong api (#30018) add 0e140a63de6 [fix](decimal) fix wrong decimal overflow caused by uninitialized nested column of null value (#29960) No new revisions were added by this update. Summary of changes: be/src/vec/functions/function_cast.h | 100 +-- 1 file changed, 97 insertions(+), 3 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](Nereids): optimize logical group expression in dphyp [doris]
yiguolei merged PR #3: URL: https://github.com/apache/doris/pull/3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated: [feature](Nereids): optimize logical group expression in dphyp (#30000)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 3e9be17f63b [feature](Nereids): optimize logical group expression in
dphyp (#3)
3e9be17f63b is described below
commit 3e9be17f63b10c8ea09eb0d53532d7e4052eebe4
Author: 谢健
AuthorDate: Tue Jan 16 17:16:41 2024 +0800
[feature](Nereids): optimize logical group expression in dphyp (#3)
---
.../org/apache/doris/nereids/StatementContext.java | 9 -
.../jobs/cascades/OptimizeGroupExpressionJob.java | 7 +-
.../doris/nereids/jobs/executor/Optimizer.java | 2 -
.../hypergraph/receiver/PlanReceiver.java | 144 +--
.../org/apache/doris/nereids/rules/RuleSet.java| 9 +-
.../nereids/trees/plans/logical/LogicalJoin.java | 7 +
.../mv/join/dphyp_inner/inner_join_dphyp.out | 335 +++
.../mv/join/dphyp_outer/outer_join_dphyp.out | 297 +
.../shape/query64.out | 128 +++---
.../rf_prune/query64.out | 92 ++--
.../nereids_tpcds_shape_sf100_p0/shape/query64.out | 100 ++---
.../mv/join/dphyp_inner/inner_join_dphyp.groovy| 464
.../mv/join/dphyp_outer/outer_join_dphyp.groovy| 469 +
13 files changed, 1760 insertions(+), 303 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/StatementContext.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/StatementContext.java
index c4a6e37bbec..4a19ab92545 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/nereids/StatementContext.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/nereids/StatementContext.java
@@ -72,7 +72,6 @@ public class StatementContext {
private int maxNAryInnerJoin = 0;
private boolean isDpHyp = false;
-private boolean isOtherJoinReorder = false;
// hasUnknownColStats true if any column stats in the tables used by this
sql is unknown
// the algorithm to derive plan when column stats are unknown is
implemented in cascading framework, not in dphyper.
@@ -158,14 +157,6 @@ public class StatementContext {
isDpHyp = dpHyp;
}
-public boolean isOtherJoinReorder() {
-return isOtherJoinReorder;
-}
-
-public void setOtherJoinReorder(boolean otherJoinReorder) {
-isOtherJoinReorder = otherJoinReorder;
-}
-
public ExprId getNextExprId() {
return exprIdGenerator.getNextId();
}
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/cascades/OptimizeGroupExpressionJob.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/cascades/OptimizeGroupExpressionJob.java
index 72426f0fa15..16cf90b786e 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/cascades/OptimizeGroupExpressionJob.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/cascades/OptimizeGroupExpressionJob.java
@@ -75,7 +75,6 @@ public class OptimizeGroupExpressionJob extends Job {
||
context.getCascadesContext().getMemo().getGroupExpressionsSize() >
context.getCascadesContext()
.getConnectContext().getSessionVariable().memoMaxGroupExpressionSize;
boolean isDpHyp =
context.getCascadesContext().getStatementContext().isDpHyp();
-boolean isOtherJoinReorder =
context.getCascadesContext().getStatementContext().isOtherJoinReorder();
boolean isEnableBushyTree =
context.getCascadesContext().getConnectContext().getSessionVariable()
.isEnableBushyTree();
boolean isLeftZigZagTree =
context.getCascadesContext().getConnectContext()
@@ -86,11 +85,7 @@ public class OptimizeGroupExpressionJob extends Job {
if (isDisableJoinReorder) {
return Collections.emptyList();
} else if (isDpHyp) {
-if (isOtherJoinReorder) {
-return getRuleSet().getDPHypReorderRules();
-} else {
-return Collections.emptyList();
-}
+return getRuleSet().getDPHypReorderRules();
} else if (isLeftZigZagTree) {
return getRuleSet().getLeftZigZagTreeJoinReorder();
} else if (isEnableBushyTree) {
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Optimizer.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Optimizer.java
index 4f042c527cb..5f945ab8383 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Optimizer.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/executor/Optimizer.java
@@ -67,7 +67,6 @@ public class Optimizer {
boolean isDpHyp = getSessionVariable().enableDPHypOptimizer
|| maxJoinCount > maxTableCount;
cascadesContext.getStatementContext().setDpHyp(isDpHyp);
-cascadesContext.get
Re: [PR] [bugfix](paimon)support native and jni to read paimon for minio/cos [doris]
yiguolei merged PR #29933: URL: https://github.com/apache/doris/pull/29933 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Performance](Join) Support all match one logic [doris]
HappenLee commented on PR #30019: URL: https://github.com/apache/doris/pull/30019#issuecomment-1893348104 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (3e9be17f63b -> bc7e1e123b4)
This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 3e9be17f63b [feature](Nereids): optimize logical group expression in dphyp (#3) add bc7e1e123b4 [bugfix](paimon)support native and jni to read paimon for minio/cos #29933 No new revisions were added by this update. Summary of changes: docs/en/docs/lakehouse/multi-catalog/paimon.md | 32 +-- docs/zh-CN/docs/lakehouse/multi-catalog/paimon.md | 32 +-- .../paimon/PaimonFileExternalCatalog.java | 15 + .../property/constants/PaimonProperties.java | 1 + .../planner/external/paimon/PaimonScanNode.java| 17 +- .../java/org/apache/doris/qe/SessionVariable.java | 14 + .../paimon/paimon_base_filesystem.out | 17 ++ .../paimon/paimon_base_filesystem.groovy | 66 ++ 8 files changed, 180 insertions(+), 14 deletions(-) create mode 100644 regression-test/data/external_table_p2/paimon/paimon_base_filesystem.out create mode 100644 regression-test/suites/external_table_p2/paimon/paimon_base_filesystem.groovy - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](statistics, metadata)Meta data place holder for statistics. [doris]
yiguolei commented on PR #29867: URL: https://github.com/apache/doris/pull/29867#issuecomment-1893349740 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](Nereids): persist constraint in table [doris]
github-actions[bot] commented on PR #29767: URL: https://github.com/apache/doris/pull/29767#issuecomment-1893350385 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [I] [Bug] backend节点实际使用的磁盘空间超出数据真实大小过多 [doris]
zhangpenggh commented on issue #30016: URL: https://github.com/apache/doris/issues/30016#issuecomment-1893350766 还有一个问题就是在磁盘使用率达到危险水位线的时候，不会主动清理这一部分数据，而且也没提供手动清理的方法。会出现因为这部分数据过大而导致磁盘被写满的情况。 建议在磁盘达到某一阈值时自动清理。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feat](Nereids): persist constraint in table [doris]
github-actions[bot] commented on PR #29767: URL: https://github.com/apache/doris/pull/29767#issuecomment-1893350315 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [Improve](Variant) support implicit cast to numeric and string type [doris]
eldenmoon opened a new pull request, #30029: URL: https://github.com/apache/doris/pull/30029 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Improve](Variant) support implicit cast to numeric and string type [doris]
eldenmoon commented on PR #30029: URL: https://github.com/apache/doris/pull/30029#issuecomment-1893353854 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [debug](don't merge) test memtable on sink node [doris]
kaijchen commented on PR #29115: URL: https://github.com/apache/doris/pull/29115#issuecomment-1893356475 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](profile)Support active_queries TVF [doris]
doris-robot commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893359728 TPC-H: Total hot run time: 39785 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 649985a951d3407b9225fa16437bbf18f114427a, data reload: false -- Round 1 -- q1 17974 663358255825 q2 2044144 133 133 q3 10907 112211851122 q4 10565 784 807 784 q5 7844312331603123 q6 203 128 128 128 q7 883 506 484 484 q8 9238197419911974 q9 7273640863966396 q10 8227311331193113 q11 408 215 217 215 q12 367 194 198 194 q13 18125 341633803380 q14 246 219 211 211 q15 555 519 506 506 q16 429 394 384 384 q17 939 526 486 486 q18 7780709369846984 q19 1730134313701343 q20 570 308 289 289 q21 2759243523902390 q22 364 324 321 321 Total cold run time: 109430 ms Total hot run time: 39785 ms - Round 2, with runtime_filter_mode=off - q1 5832565556485648 q2 345 231 220 220 q3 3327312931823129 q4 2198210720222022 q5 6114589660055896 q6 209 122 125 122 q7 2428194320321943 q8 3610368236253625 q9 971225174 99929992 q10 4281391037443744 q11 580 465 452 452 q12 1177641 641 641 q13 17085 332232213221 q14 366 255 268 255 q15 576 498 504 498 q16 546 506 493 493 q17 7947206719761976 q18 9704963996099609 q19 12508 158416301584 q20 3472194019521940 q21 13845 574260715742 q22 926 607 598 598 Total cold run time: 106788 ms Total hot run time: 63350 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids): find hash condition after infer predicate [doris]
doris-robot commented on PR #30026: URL: https://github.com/apache/doris/pull/30026#issuecomment-1893361001 TPC-H: Total hot run time: 39629 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit a2f48815c4defec1dfaed7f993e03f2de4390c68, data reload: false -- Round 1 -- q1 18012 603658235823 q2 2049144 131 131 q3 10882 112811511128 q4 10519 750 807 750 q5 7818315631603156 q6 203 122 124 122 q7 882 496 493 493 q8 9259221420222022 q9 7313644063996399 q10 8240299430582994 q11 424 212 207 207 q12 361 196 195 195 q13 18113 345134093409 q14 250 227 221 221 q15 555 513 506 506 q16 439 403 387 387 q17 948 503 501 501 q18 7643699568356835 q19 1578132014341320 q20 557 329 325 325 q21 2830249223962396 q22 364 326 309 309 Total cold run time: 109239 ms Total hot run time: 39629 ms - Round 2, with runtime_filter_mode=off - q1 6023586056905690 q2 347 244 225 225 q3 3332308330773077 q4 2169200720632007 q5 6009596358045804 q6 200 124 121 121 q7 2335192119401921 q8 3564365138823651 q9 961725053 95689568 q10 5543382838213821 q11 855 472 464 464 q12 1173633 644 633 q13 17091 326232303230 q14 322 268 279 268 q15 561 519 516 516 q16 538 479 494 479 q17 9010207619601960 q18 9584962810865 9628 q19 13348 159015871587 q20 3454194319331933 q21 14846 555356155553 q22 757 612 598 598 Total cold run time: 110678 ms Total hot run time: 62734 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](profile)Support active_queries TVF [doris]
doris-robot commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893362772 TeamCity be ut coverage result: Function Coverage: 36.67% (8646/23579) Line Coverage: 28.69% (70454/245561) Region Coverage: 27.62% (36422/131879) Branch Coverage: 24.33% (18634/76578) Coverage Report: http://coverage.selectdb-in.cc/coverage/649985a951d3407b9225fa16437bbf18f114427a_649985a951d3407b9225fa16437bbf18f114427a/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](statistics, metadata)Meta data place holder for statistics. [doris]
Jibing-Li commented on PR #29867: URL: https://github.com/apache/doris/pull/29867#issuecomment-1893363587 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [branch-2.0](test-framework) Support operator performance test for branch2.0 [doris]
yiguolei merged PR #29661: URL: https://github.com/apache/doris/pull/29661 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch branch-2.0 updated: [branch-2.0](test-framework) Support operator performance test for branch2.0 (#29661)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-2.0 by this push:
new 759a6943ec5 [branch-2.0](test-framework) Support operator performance
test for branch2.0 (#29661)
759a6943ec5 is described below
commit 759a6943ec555aceafab742f461880e2d75773d2
Author: zclllyybb
AuthorDate: Tue Jan 16 17:30:12 2024 +0800
[branch-2.0](test-framework) Support operator performance test for
branch2.0 (#29661)
* [Opt](functions) Opt tvf number for performance regression framework
(#27582)
Opt tvf number for performance regression framework
* [Feature](functions) support ignore and nullable functions (#27848)
support ignore and nullable functions
* [Feature](function) support generating const values from tvf numbers
(#28051)
If specified, got a column of constant. otherwise an incremental series
like it always be.
mysql> select * from numbers("number" = "5", "const_value" = "-123");
++
| number |
++
| -123 |
| -123 |
| -123 |
| -123 |
| -123 |
++
5 rows in set (0.11 sec)
* fix compile
* [feature](nereids) support non_nullable function (#23762)
* fix cases
-
Co-authored-by: minghong
---
be/src/vec/columns/column_vector.h | 20 -
be/src/vec/columns/columns_number.h| 2 +
.../vec/exec/data_gen_functions/vnumbers_tvf.cpp | 76 ++
be/src/vec/exec/data_gen_functions/vnumbers_tvf.h | 11 +--
be/src/vec/functions/function_ignore.cpp | 50
...tion_nonnullable.cpp => function_nullables.cpp} | 66 +++-
be/src/vec/functions/simple_function_factory.h | 6 +-
.../sql-functions/table-functions/numbers.md | 31 +---
.../sql-functions/table-functions/numbers.md | 30 ---
.../doris/catalog/BuiltinScalarFunctions.java | 6 ++
.../trees/expressions/functions/scalar/Ignore.java | 69
.../expressions/functions/scalar/NonNullable.java | 42 ++
.../expressions/functions/scalar/Nullable.java | 42 ++
.../trees/expressions/functions/table/Numbers.java | 24 +++---
.../expressions/visitor/ScalarFunctionVisitor.java | 5 ++
.../tablefunction/NumbersTableValuedFunction.java | 53 -
gensrc/script/doris_builtins_functions.py | 82 +++
gensrc/thrift/PlanNodes.thrift | 4 +-
.../data/external_table_p0/tvf/test_numbers.out| 19 +
.../cast_function/test_non_nullable_function.out | 22 --
.../cast_function/test_nullable_functions.out | 19 +
.../external_table_p0/tvf/test_numbers.groovy | 9 ++-
.../test_non_nullable_function.groovy | 50
.../cast_function/test_nullable_functions.groovy | 91 ++
24 files changed, 643 insertions(+), 186 deletions(-)
diff --git a/be/src/vec/columns/column_vector.h
b/be/src/vec/columns/column_vector.h
index 41000ffd281..512fe5e9ce7 100644
--- a/be/src/vec/columns/column_vector.h
+++ b/be/src/vec/columns/column_vector.h
@@ -145,7 +145,7 @@ public:
using Container = PaddedPODArray;
private:
-ColumnVector() {}
+ColumnVector() = default;
ColumnVector(const size_t n) : data(n) {}
ColumnVector(const size_t n, const value_type x) : data(n, x) {}
ColumnVector(const ColumnVector& src) : data(src.data.begin(),
src.data.end()) {}
@@ -178,7 +178,7 @@ public:
size_t size() const override { return data.size(); }
StringRef get_data_at(size_t n) const override {
-return StringRef(reinterpret_cast(&data[n]),
sizeof(data[n]));
+return {reinterpret_cast(&data[n]), sizeof(data[n])};
}
void insert_from(const IColumn& src, size_t n) override {
@@ -196,6 +196,22 @@ public:
memcpy(data.data() + old_size, data_ptr, num * sizeof(T));
}
+void insert_raw_integers(T val, size_t n) {
+auto old_size = data.size();
+data.resize(old_size + n);
+std::fill(data.data() + old_size, data.data() + old_size + n, val);
+}
+
+void insert_range_of_integer(T begin, T end)
+requires std::is_fundamental_v
+{
+auto old_size = data.size();
+data.resize(old_size + (end - begin));
+for (int i = 0; i < end - begin; i++) {
+data[old_size + i] = begin + i;
+}
+}
+
void insert_date_column(const char* data_ptr, size_t num) {
data.reserve(data.size() + num);
size_t input_value_size = sizeof(uint24_t);
diff --git a/be/src/vec/columns/columns_number.h
b/be/src/vec/columns/columns_number.h
index 1ce930e4cd1..66c181af90c 100644
--- a/be/src/vec/columns/columns_number.h
+++ b/be/src/vec/columns/columns_numb
Re: [PR] [fix](disk balance) Change disk rebalance unpick time to configurable [doris]
yiguolei merged PR #28949: URL: https://github.com/apache/doris/pull/28949 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (bc7e1e123b4 -> b9db7c417cd)
This is an automated email from the ASF dual-hosted git repository. yiguolei pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from bc7e1e123b4 [bugfix](paimon)support native and jni to read paimon for minio/cos #29933 add b9db7c417cd [fix](disk balance) Change disk rebalance unpick time to configurable (#28949) No new revisions were added by this update. Summary of changes: fe/fe-common/src/main/java/org/apache/doris/common/Config.java | 6 ++ fe/fe-core/src/main/java/org/apache/doris/clone/Rebalancer.java | 3 ++- 2 files changed, 8 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](config) remove some unused config [doris]
github-actions[bot] commented on PR #29983: URL: https://github.com/apache/doris/pull/29983#issuecomment-1893372906 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](config) remove some unused config [doris]
github-actions[bot] commented on PR #29983: URL: https://github.com/apache/doris/pull/29983#issuecomment-1893372838 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](arm) Support auto-SIMD on arm and refactor compilation docs [doris]
doris-robot commented on PR #29956: URL: https://github.com/apache/doris/pull/29956#issuecomment-1893373057 TeamCity be ut coverage result: Function Coverage: 36.71% (8655/23576) Line Coverage: 28.72% (70515/245533) Region Coverage: 27.64% (36455/131872) Branch Coverage: 24.36% (18654/76574) Coverage Report: http://coverage.selectdb-in.cc/coverage/1be2a39ef085fde7455fc348720f9f9e1490a244_1be2a39ef085fde7455fc348720f9f9e1490a244/report/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](arm) Support auto-SIMD on arm and refactor compilation docs [doris]
doris-robot commented on PR #29956: URL: https://github.com/apache/doris/pull/29956#issuecomment-1893373264 TPC-H: Total hot run time: 39773 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 1be2a39ef085fde7455fc348720f9f9e1490a244, data reload: false -- Round 1 -- q1 17611 569757105697 q2 2046158 142 142 q3 11014 118711531153 q4 10612 822 853 822 q5 8080318132423181 q6 202 124 128 124 q7 906 516 498 498 q8 9576195820181958 q9 7868654065206520 q10 8753303330353033 q11 419 211 217 211 q12 359 187 196 187 q13 17986 339234023392 q14 254 223 217 217 q15 547 514 499 499 q16 434 373 387 373 q17 942 522 495 495 q18 7604707768546854 q19 1613135413731354 q20 528 322 299 299 q21 2825256024542454 q22 342 310 312 310 Total cold run time: 110521 ms Total hot run time: 39773 ms - Round 2, with runtime_filter_mode=off - q1 5962577956415641 q2 333 221 225 221 q3 3392327431803180 q4 2114200919981998 q5 6022597759955977 q6 200 121 117 117 q7 2423183018981830 q8 3330349634093409 q9 9298881115322 8811 q10 4061384038253825 q11 578 452 442 442 q12 808 626 623 623 q13 16937 319431293129 q14 289 247 281 247 q15 553 505 507 505 q16 527 484 467 467 q17 2021195819121912 q18 9749935313051 9353 q19 22041 157115921571 q20 4103192619271926 q21 12004 561253915391 q22 980 509 527 509 Total cold run time: 107725 ms Total hot run time: 61084 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](profile)Support active_queries TVF [doris]
doris-robot commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893378517 TPC-DS: Total hot run time: 178578 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 649985a951d3407b9225fa16437bbf18f114427a, data reload: false query1 923 342 323 323 query2 6727185218751852 query3 6703210 206 206 query4 34112 22072 22278 22072 query5 6940594 541 541 query6 257 178 193 178 query7 4615285 280 280 query8 236 189 192 189 query9 9201286327052705 query10 560 245 245 245 query11 16835 15340 15283 15283 query12 133 72 69 69 query13 1693393 377 377 query14 11308 735873917358 query15 220 183 185 183 query16 4619257 249 249 query17 1001490 483 483 query18 1796280 259 259 query19 181 153 148 148 query20 79 81 73 73 query21 188 138 137 137 query22 5018493348904890 query23 31867 30937 31182 30937 query24 11130 276928662769 query25 542 350 320 320 query26 899 152 151 151 query27 2886283 278 278 query28 6293188118781878 query29 1015678 689 678 query30 281 137 138 137 query31 929 763 775 763 query32 82 63 60 60 query33 606 238 251 238 query34 878 470 465 465 query35 888 769 774 769 query36 1362136812881288 query37 106 70 68 68 query38 3434330332273227 query39 1324127712711271 query40 219 93 96 93 query41 36 35 36 35 query42 102 94 100 94 query43 526 503 493 493 query44 1032717 712 712 query45 208 184 184 184 query46 1074632 636 632 query47 1712152016321520 query48 416 323 313 313 query49 1121307 322 307 query50 700 314 329 314 query51 5441522351795179 query52 99 93 94 93 query53 352 293 308 293 query54 878 458 469 458 query55 93 94 83 83 query56 208 196 198 196 query57 10101047963 963 query58 199 191 188 188 query59 3037276127782761 query60 250 238 230 230 query61 86 83 89 83 query62 635 408 409 408 query63 307 299 286 286 query64 4150164216941642 query65 3361328732553255 query66 1280344 323 323 query67 15788 15211 15114 15114 query68 12021 533 520 520 query69 632 330 338 330 query70 1679157415231523 query71 486 227 235 227 query72 5235284328642843 query73 3137328 322 322 query74 6984640364146403 query75 4981232122802280 query76 5897868 1083868 query77 680 264 292 264 query78 9174894085328532 query79 1010499 513 499 query80 553 350 346 346 query81 469 204 205 204 query82 211 97 85 85 query83 145 124 121 121 query84 281 75 74 74 query85 1061336 326 326 query86 396 420 378 378 query87 3517337634043376 query88 3044223622092209 query89 445 381 402 381 query90 2031206 205 205 query91 154 128 122 122 query92 65 58 57 57 query93 1424434 446 434 query94 1222186 179 179 query95 525 475 468 468 query96 614 313 318 313 query97 4308413642344136 query98 205 197 188 188 query99 1014716 783 716 Total cold run time: 295787 ms Total hot run time: 178578 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [opt](scanner) optimize the number of threads of scanners, follow up #28640 [doris]
AshinGau commented on PR #30030: URL: https://github.com/apache/doris/pull/30030#issuecomment-1893379622 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[PR] [opt](scanner) optimize the number of threads of scanners, follow up #28640 [doris]
AshinGau opened a new pull request, #30030: URL: https://github.com/apache/doris/pull/30030 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [feature](merge-cloud) Add create cloud table [doris]
github-actions[bot] commented on PR #30001: URL: https://github.com/apache/doris/pull/30001#issuecomment-1893380015 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids): find hash condition after infer predicate [doris]
doris-robot commented on PR #30026: URL: https://github.com/apache/doris/pull/30026#issuecomment-1893380135 TPC-DS: Total hot run time: 180257 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit a2f48815c4defec1dfaed7f993e03f2de4390c68, data reload: false query1 928 334 330 330 query2 6737187520001875 query3 6718210 205 205 query4 33472 22262 22272 22262 query5 6920557 583 557 query6 264 198 178 178 query7 4626282 273 273 query8 230 199 202 199 query9 9147272128312721 query10 454 232 239 232 query11 16395 15200 15274 15200 query12 123 71 71 71 query13 1704396 382 382 query14 11306 744074037403 query15 212 179 180 179 query16 4623258 243 243 query17 1028494 477 477 query18 1818277 284 277 query19 186 149 146 146 query20 77 85 71 71 query21 197 130 121 121 query22 5116477849874778 query23 32386 31391 31520 31391 query24 12722 291828632863 query25 594 351 356 351 query26 1828162 167 162 query27 3884306 314 306 query28 8059188018691869 query29 3331762 749 749 query30 738 178 147 147 query31 1857805 785 785 query32 77 67 64 64 query33 709 255 267 255 query34 1243473 470 470 query35 939 848 793 793 query36 1362127213341272 query37 115 78 79 78 query38 3404328232713271 query39 1323130412731273 query40 342 100 98 98 query41 36 34 35 34 query42 99 98 92 92 query43 586 496 538 496 query44 1038696 712 696 query45 198 185 187 185 query46 1066637 639 637 query47 1699159116101591 query48 413 311 322 311 query49 1220308 310 308 query50 698 312 313 312 query51 5399516951865169 query52 90 95 92 92 query53 381 286 287 286 query54 898 456 464 456 query55 92 87 84 84 query56 209 206 196 196 query57 996 960 959 959 query58 206 194 195 194 query59 3084289827592759 query60 243 224 219 219 query61 86 81 89 81 query62 635 406 391 391 query63 312 289 307 289 query64 6268168917011689 query65 3366325032663250 query66 1361349 332 332 query67 15965 15410 15214 15214 query68 9961543 540 540 query69 617 342 337 337 query70 1747157615701570 query71 544 239 255 239 query72 4512286329002863 query73 1893326 318 318 query74 7072643265586432 query75 4602234022682268 query76 6232973 1064973 query77 655 272 301 272 query78 9060897888298829 query79 1071505 508 505 query80 689 355 364 355 query81 464 205 208 205 query82 194 88 96 88 query83 166 121 123 121 query84 276 78 74 74 query85 1060335 325 325 query86 411 359 370 359 query87 3625339334013393 query88 3081219721982197 query89 448 390 392 390 query90 2037218 208 208 query91 154 123 125 123 query92 66 56 54 54 query93 963 452 429 429 query94 1099184 179 179 query95 522 482 489 482 query96 619 322 321 321 query97 4350419842104198 query98 207 193 187 187 query99 1007724 754 724 Total cold run time: 303242 ms Total hot run time: 180257 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s
Re: [PR] [opt](scanner) optimize the number of threads of scanners, follow up #28640 [doris]
github-actions[bot] commented on PR #30030: URL: https://github.com/apache/doris/pull/30030#issuecomment-1893386195 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [opt](scanner) optimize the number of threads of scanners, follow up #28640 [doris]
github-actions[bot] commented on PR #30030: URL: https://github.com/apache/doris/pull/30030#issuecomment-1893386264 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](arm) Support auto-SIMD on arm and refactor compilation docs [doris]
github-actions[bot] commented on PR #29956: URL: https://github.com/apache/doris/pull/29956#issuecomment-1893386534 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [improvement](catalog) Change the push-down parameters of the predicate function of the table query SQL into variables [doris]
doris-robot commented on PR #30028: URL: https://github.com/apache/doris/pull/30028#issuecomment-1893386758 TPC-H: Total hot run time: 39127 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 3d5874438fee1a80d908d18b4cedf7aeb8cae834, data reload: false -- Round 1 -- q1 17719 652658185818 q2 2053149 127 127 q3 10866 107411531074 q4 10475 751 743 743 q5 7788302430643024 q6 208 125 123 123 q7 903 493 474 474 q8 9267193519781935 q9 7279636563616361 q10 8224305830553055 q11 417 200 209 200 q12 364 193 190 190 q13 18006 341633523352 q14 245 209 236 209 q15 547 512 499 499 q16 435 383 366 366 q17 940 547 507 507 q18 7345677467366736 q19 1571132813651328 q20 570 281 311 281 q21 2828244524262426 q22 355 299 302 299 Total cold run time: 108405 ms Total hot run time: 39127 ms - Round 2, with runtime_filter_mode=off - q1 5931572456515651 q2 325 227 220 220 q3 3335321032643210 q4 2040206720372037 q5 5924599259275927 q6 201 115 120 115 q7 2332190118721872 q8 3257345635323456 q9 9200938317908 9383 q10 3945384837863786 q11 579 475 452 452 q12 779 596 616 596 q13 16971 318531673167 q14 302 257 263 257 q15 551 500 498 498 q16 524 472 499 472 q17 2011199219221922 q18 9726948513890 9485 q19 23787 159415831583 q20 4546194219211921 q21 13250 558454425442 q22 987 498 518 498 Total cold run time: 110503 ms Total hot run time: 61950 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Feature](profile)Support active_queries TVF [doris]
doris-robot commented on PR #2: URL: https://github.com/apache/doris/pull/2#issuecomment-1893387414 ClickBench: Total hot run time: 31.44 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 649985a951d3407b9225fa16437bbf18f114427a, data reload: false query1 0.060.060.06 query2 0.060.030.03 query3 0.260.120.11 query4 1.760.130.12 query5 0.530.530.53 query6 1.370.650.65 query7 0.010.010.01 query8 0.040.030.03 query9 0.540.530.49 query10 0.560.570.56 query11 0.120.090.09 query12 0.110.090.09 query13 0.600.600.59 query14 0.770.800.81 query15 0.780.780.76 query16 0.360.380.37 query17 1.031.021.03 query18 0.250.250.25 query19 1.871.771.81 query20 0.020.010.01 query21 15.40 0.560.56 query22 2.492.272.14 query23 17.08 0.800.73 query24 2.521.710.84 query25 0.430.250.14 query26 0.540.150.13 query27 0.070.060.05 query28 10.92 0.810.78 query29 12.57 3.423.41 query30 0.580.510.51 query31 2.800.340.35 query32 3.390.480.49 query33 3.203.223.23 query34 15.94 4.224.21 query35 4.254.224.22 query36 1.111.071.08 query37 0.070.050.05 query38 0.040.020.02 query39 0.020.020.02 query40 0.160.130.14 query41 0.070.020.01 query42 0.020.020.02 query43 0.030.020.02 Total cold run time: 104.8 s Total hot run time: 31.44 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [DNM](Nereids) test disable fallback [doris]
doris-robot commented on PR #25344: URL: https://github.com/apache/doris/pull/25344#issuecomment-1893386516 TPC-H: Total hot run time: 39502 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 2ed197cd08b6216c42679ac394a54f085f9bd975, data reload: false -- Round 1 -- q1 17658 578857845784 q2 2041147 131 131 q3 10845 110411931104 q4 10475 788 801 788 q5 7772308731193087 q6 206 125 124 124 q7 936 493 483 483 q8 9220195420001954 q9 7284638163756375 q10 8218309030833083 q11 416 209 205 205 q12 365 194 191 191 q13 18013 342734113411 q14 236 212 212 212 q15 546 505 499 499 q16 443 376 393 376 q17 931 520 503 503 q18 7376687168196819 q19 1602130513631305 q20 539 300 308 300 q21 2842245525102455 q22 345 322 313 313 Total cold run time: 108309 ms Total hot run time: 39502 ms - Round 2, with runtime_filter_mode=off - q1 5946563756765637 q2 329 227 217 217 q3 3309321531733173 q4 2090201720632017 q5 6070595959575957 q6 200 118 121 118 q7 2298189818261826 q8 3281347334163416 q9 9219869517718 8695 q10 4082375638243756 q11 579 465 457 457 q12 913 624 653 624 q13 16965 318431613161 q14 277 260 264 260 q15 550 505 507 505 q16 529 476 478 476 q17 2078196919431943 q18 9486930612393 9306 q19 18131 163416101610 q20 3832197319431943 q21 11259 570954925492 q22 1014502 521 502 Total cold run time: 102437 ms Total hot run time: 61091 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] 0116 perf required [doris]
doris-robot commented on PR #30020: URL: https://github.com/apache/doris/pull/30020#issuecomment-1893386579 TPC-H: Total hot run time: 39302 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 3a329a8ec014a382178137deb2a9aa04f855adb8, data reload: false -- Round 1 -- q1 17691 588358105810 q2 2041138 134 134 q3 10856 108611441086 q4 10476 756 786 756 q5 7761300331733003 q6 202 124 125 124 q7 869 487 467 467 q8 9211197119861971 q9 7236636363596359 q10 8206303730633037 q11 424 201 201 201 q12 357 186 194 186 q13 17980 337033803370 q14 243 224 212 212 q15 535 511 498 498 q16 431 380 402 380 q17 934 488 479 479 q18 7377704568116811 q19 1619137914051379 q20 524 278 300 278 q21 2841246424572457 q22 354 320 304 304 Total cold run time: 108168 ms Total hot run time: 39302 ms - Round 2, with runtime_filter_mode=off - q1 5974571857365718 q2 325 218 219 218 q3 3338317631483148 q4 2094207120292029 q5 6021590558595859 q6 200 122 121 121 q7 2335195218181818 q8 3316344734673447 q9 9180949715661 9497 q10 3953377038433770 q11 576 449 450 449 q12 807 625 610 610 q13 16961 318131673167 q14 282 256 263 256 q15 559 506 504 504 q16 543 472 488 472 q17 1981194519381938 q18 9549951611669 9516 q19 21108 161316151613 q20 4028191519281915 q21 11612 548954665466 q22 1015540 528 528 Total cold run time: 105757 ms Total hot run time: 62059 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [Chore](arm) Support auto-SIMD on arm and refactor compilation docs [doris]
zhangstar333 merged PR #29956: URL: https://github.com/apache/doris/pull/29956 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
(doris) branch master updated (b9db7c417cd -> 0ae9fa1c337)
This is an automated email from the ASF dual-hosted git repository. zhangstar333 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from b9db7c417cd [fix](disk balance) Change disk rebalance unpick time to configurable (#28949) add 0ae9fa1c337 [Chore](arm) Support auto-SIMD on arm and refactor compilation docs (#29956) No new revisions were added by this update. Summary of changes: be/CMakeLists.txt | 10 + docs/en/docs/advanced/time-zone.md | 7 +- .../docs/install/source-install/compilation-arm.md | 659 ++-- docs/zh-CN/docs/advanced/time-zone.md | 7 +- .../docs/install/source-install/compilation-arm.md | 670 +++-- 5 files changed, 697 insertions(+), 656 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
Re: [PR] [fix](Nereids): find hash condition after infer predicate [doris]
doris-robot commented on PR #30026: URL: https://github.com/apache/doris/pull/30026#issuecomment-1893388946 ClickBench: Total hot run time: 31.17 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit a2f48815c4defec1dfaed7f993e03f2de4390c68, data reload: false query1 0.060.060.05 query2 0.050.020.02 query3 0.250.120.11 query4 1.790.130.11 query5 0.540.520.53 query6 1.370.650.62 query7 0.020.010.02 query8 0.040.030.03 query9 0.540.510.50 query10 0.560.560.57 query11 0.120.080.08 query12 0.110.090.09 query13 0.610.600.60 query14 0.790.770.78 query15 0.790.780.78 query16 0.380.390.37 query17 1.031.041.01 query18 0.220.260.26 query19 1.811.821.84 query20 0.010.020.01 query21 15.40 0.610.57 query22 2.402.821.99 query23 17.48 0.710.75 query24 2.421.260.97 query25 0.420.290.15 query26 0.500.140.14 query27 0.060.050.05 query28 11.85 0.790.80 query29 12.62 3.153.16 query30 0.570.550.48 query31 2.780.340.35 query32 3.430.500.49 query33 3.233.243.24 query34 16.24 4.254.23 query35 4.244.284.21 query36 1.131.081.08 query37 0.060.040.05 query38 0.040.030.03 query39 0.020.020.01 query40 0.160.130.13 query41 0.070.020.02 query42 0.030.020.01 query43 0.020.020.02 Total cold run time: 106.26 s Total hot run time: 31.17 s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
