[GitHub] [doris] github-actions[bot] commented on pull request #22232: [fix](case) add sync after stream load
github-actions[bot] commented on PR #22232: URL: https://github.com/apache/doris/pull/22232#issuecomment-1655136051 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] morrySnow closed issue #21436: [Bug] Report unexpected exception for a nested sub query.
morrySnow closed issue #21436: [Bug] Report unexpected exception for a nested sub query. URL: https://github.com/apache/doris/issues/21436 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22238: [fix](compaction) fix time series compaction policy corner case
github-actions[bot] commented on PR #22238: URL: https://github.com/apache/doris/pull/22238#issuecomment-1655136831 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22158: [improvement](stream-load) add http request field check for stream load in BE
github-actions[bot] commented on PR #22158: URL: https://github.com/apache/doris/pull/22158#issuecomment-1655142590 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-spark-connector] branch master updated: [feature] support two phase commit (#122)
This is an automated email from the ASF dual-hosted git repository.
diwu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-spark-connector.git
The following commit(s) were added to refs/heads/master by this push:
new b1fbc6e [feature] support two phase commit (#122)
b1fbc6e is described below
commit b1fbc6e5e314100214ef89f8bb11b972515bfc7c
Author: gnehil
AuthorDate: Fri Jul 28 15:07:51 2023 +0800
[feature] support two phase commit (#122)
---
.../doris/spark/cfg/ConfigurationOptions.java | 3 +
.../java/org/apache/doris/spark/cfg/Settings.java | 11 +
.../apache/doris/spark/load/DorisStreamLoad.java | 267 +++--
.../doris/spark/rest/models/RespContent.java | 4 +
.../org/apache/doris/spark/util/ResponseUtil.java | 33 +++
.../spark/listener/DorisTransactionListener.scala | 83 +++
.../scala/org/apache/doris/spark/sql/Utils.scala | 2 +-
.../apache/doris/spark/writer/DorisWriter.scala| 34 ++-
8 files changed, 358 insertions(+), 79 deletions(-)
diff --git
a/spark-doris-connector/src/main/java/org/apache/doris/spark/cfg/ConfigurationOptions.java
b/spark-doris-connector/src/main/java/org/apache/doris/spark/cfg/ConfigurationOptions.java
index 61184f9..2ab200d 100644
---
a/spark-doris-connector/src/main/java/org/apache/doris/spark/cfg/ConfigurationOptions.java
+++
b/spark-doris-connector/src/main/java/org/apache/doris/spark/cfg/ConfigurationOptions.java
@@ -97,4 +97,7 @@ public interface ConfigurationOptions {
*/
String DORIS_IGNORE_TYPE = "doris.ignore-type";
+String DORIS_SINK_ENABLE_2PC = "doris.sink.enable-2pc";
+boolean DORIS_SINK_ENABLE_2PC_DEFAULT = false;
+
}
diff --git
a/spark-doris-connector/src/main/java/org/apache/doris/spark/cfg/Settings.java
b/spark-doris-connector/src/main/java/org/apache/doris/spark/cfg/Settings.java
index d2e845a..798ec8c 100644
---
a/spark-doris-connector/src/main/java/org/apache/doris/spark/cfg/Settings.java
+++
b/spark-doris-connector/src/main/java/org/apache/doris/spark/cfg/Settings.java
@@ -62,6 +62,17 @@ public abstract class Settings {
return defaultValue;
}
+public Boolean getBooleanProperty(String name) {
+return getBooleanProperty(name, null);
+}
+
+public Boolean getBooleanProperty(String name, Boolean defaultValue) {
+if (getProperty(name) != null) {
+return Boolean.valueOf(getProperty(name));
+}
+return defaultValue;
+}
+
public Settings merge(Properties properties) {
if (properties == null || properties.isEmpty()) {
return this;
diff --git
a/spark-doris-connector/src/main/java/org/apache/doris/spark/load/DorisStreamLoad.java
b/spark-doris-connector/src/main/java/org/apache/doris/spark/load/DorisStreamLoad.java
index 5341f67..c40420d 100644
---
a/spark-doris-connector/src/main/java/org/apache/doris/spark/load/DorisStreamLoad.java
+++
b/spark-doris-connector/src/main/java/org/apache/doris/spark/load/DorisStreamLoad.java
@@ -23,8 +23,10 @@ import org.apache.doris.spark.rest.RestService;
import org.apache.doris.spark.rest.models.BackendV2;
import org.apache.doris.spark.rest.models.RespContent;
import org.apache.doris.spark.util.ListUtils;
+import org.apache.doris.spark.util.ResponseUtil;
import com.fasterxml.jackson.core.JsonProcessingException;
+import com.fasterxml.jackson.core.type.TypeReference;
import com.fasterxml.jackson.databind.ObjectMapper;
import com.google.common.cache.CacheBuilder;
import com.google.common.cache.CacheLoader;
@@ -34,6 +36,7 @@ import org.apache.commons.lang3.StringUtils;
import org.apache.http.HttpHeaders;
import org.apache.http.HttpResponse;
import org.apache.http.HttpStatus;
+import org.apache.http.client.methods.CloseableHttpResponse;
import org.apache.http.client.methods.HttpPut;
import org.apache.http.entity.BufferedHttpEntity;
import org.apache.http.entity.StringEntity;
@@ -74,6 +77,9 @@ public class DorisStreamLoad implements Serializable {
private final static List DORIS_SUCCESS_STATUS = new
ArrayList<>(Arrays.asList("Success", "Publish Timeout"));
private static String loadUrlPattern = "http://%s/api/%s/%s/_stream_load?";;
+
+private static String abortUrlPattern =
"http://%s/api/%s/%s/_stream_load_2pc?";;
+
private String user;
private String passwd;
private String loadUrlStr;
@@ -99,9 +105,7 @@ public class DorisStreamLoad implements Serializable {
this.columns =
settings.getProperty(ConfigurationOptions.DORIS_WRITE_FIELDS);
this.maxFilterRatio =
settings.getProperty(ConfigurationOptions.DORIS_MAX_FILTER_RATIO);
this.streamLoadProp = getStreamLoadProp(settings);
-cache = CacheBuilder.newBuilder()
-.expireAfterWrite(cacheExpireTimeout, TimeUnit.MINUTES)
-.build(new BackendCacheLoader(settings));
+cache = CacheBuilder.newBuilder().expireAfterWrite(cacheExpireTimeout
[GitHub] [doris-spark-connector] JNSimba merged pull request #122: [feature] support two phase commit
JNSimba merged PR #122: URL: https://github.com/apache/doris-spark-connector/pull/122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] morrySnow merged pull request #22285: [fix](Nereids) project hidden columns when `show_hidden_columns` is true
morrySnow merged PR #22285: URL: https://github.com/apache/doris/pull/22285 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [fix](Nereids) project hidden columns when show_hidden_columns is true (#22285)
This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 80673406b1 [fix](Nereids) project hidden columns when
show_hidden_columns is true (#22285)
80673406b1 is described below
commit 80673406b11060a5aab1346b8b1b0c844f855c77
Author: 谢健
AuthorDate: Fri Jul 28 15:08:18 2023 +0800
[fix](Nereids) project hidden columns when show_hidden_columns is true
(#22285)
---
.../doris/nereids/rules/analysis/SlotBinder.java | 5 ++-
.../nereids_p0/test_selelct_hidden_col.groovy | 40 ++
2 files changed, 44 insertions(+), 1 deletion(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/SlotBinder.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/SlotBinder.java
index e5f13007bd..94c4b4f07d 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/SlotBinder.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/SlotBinder.java
@@ -17,6 +17,7 @@
package org.apache.doris.nereids.rules.analysis;
+import org.apache.doris.common.util.Util;
import org.apache.doris.nereids.CascadesContext;
import org.apache.doris.nereids.analyzer.Scope;
import org.apache.doris.nereids.analyzer.UnboundAlias;
@@ -131,9 +132,11 @@ class SlotBinder extends SubExprAnalyzer {
@Override
public Expression visitUnboundStar(UnboundStar unboundStar,
CascadesContext context) {
List qualifier = unboundStar.getQualifier();
+boolean showHidden = Util.showHiddenColumns();
List slots = getScope().getSlots()
.stream()
-.filter(slot -> !(slot instanceof SlotReference) ||
((SlotReference) slot).isVisible())
+.filter(slot -> !(slot instanceof SlotReference)
+|| (((SlotReference) slot).isVisible()) || showHidden)
.collect(Collectors.toList());
switch (qualifier.size()) {
case 0: // select *
diff --git a/regression-test/suites/nereids_p0/test_selelct_hidden_col.groovy
b/regression-test/suites/nereids_p0/test_selelct_hidden_col.groovy
new file mode 100644
index 00..b9d2d669f9
--- /dev/null
+++ b/regression-test/suites/nereids_p0/test_selelct_hidden_col.groovy
@@ -0,0 +1,40 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+suite("test_select_hidden") {
+sql "SET enable_nereids_planner=true"
+sql "SET enable_fallback_to_original_planner=false"
+sql "set show_hidden_columns=true;"
+sql """
+CREATE TABLE IF NOT EXISTS hidden_tb (
+`uid` BIGINT NULL,
+`v1` BIGINT NULL
+)
+UNIQUE KEY(uid)
+DISTRIBUTED BY HASH(uid) BUCKETS 3
+PROPERTIES (
+"enable_unique_key_merge_on_write" = "true",
+"replication_num" = "1"
+);
+"""
+explain {
+sql("select * from hidden_tb")
+contains "__DORIS_VERSION_COL__"
+}
+
+sql "drop table if exists hidden_tb"
+}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] morrySnow merged pull request #22262: [fix](nereids)SubqueryToApply may lost conjunct
morrySnow merged PR #22262: URL: https://github.com/apache/doris/pull/22262 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [fix](nereids) SubqueryToApply may lost conjunct (#22262)
This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 5a0ad09856 [fix](nereids) SubqueryToApply may lost conjunct (#22262)
5a0ad09856 is described below
commit 5a0ad098560e0ab0819249bc81a281110c1abbe4
Author: starocean999 <40539150+starocean...@users.noreply.github.com>
AuthorDate: Fri Jul 28 15:08:56 2023 +0800
[fix](nereids) SubqueryToApply may lost conjunct (#22262)
consider sql:
```
SELECT *
FROM sub_query_correlated_subquery1 t1
WHERE coalesce(bitand(
cast(
(SELECT sum(k1)
FROM sub_query_correlated_subquery3 ) AS int),
cast(t1.k1 AS int)),
coalesce(t1.k1, t1.k2)) is NULL
ORDER BY t1.k1, t1.k2;
```
is Null conjunct is lost in SubqueryToApply rule. This pr fix it
---
.../nereids/rules/analysis/SubqueryToApply.java| 140 +
.../nereids_syntax_p0/sub_query_correlated.out | 17 +++
.../nereids_syntax_p0/sub_query_correlated.groovy | 23 ++--
3 files changed, 66 insertions(+), 114 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/SubqueryToApply.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/SubqueryToApply.java
index fb39794c23..6b89d02782 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/SubqueryToApply.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/SubqueryToApply.java
@@ -24,15 +24,11 @@ import org.apache.doris.nereids.rules.RuleType;
import org.apache.doris.nereids.trees.expressions.Alias;
import org.apache.doris.nereids.trees.expressions.BinaryOperator;
import org.apache.doris.nereids.trees.expressions.CaseWhen;
-import org.apache.doris.nereids.trees.expressions.ComparisonPredicate;
-import org.apache.doris.nereids.trees.expressions.CompoundPredicate;
import org.apache.doris.nereids.trees.expressions.Exists;
import org.apache.doris.nereids.trees.expressions.Expression;
import org.apache.doris.nereids.trees.expressions.InSubquery;
-import org.apache.doris.nereids.trees.expressions.IsNull;
import org.apache.doris.nereids.trees.expressions.MarkJoinSlotReference;
import org.apache.doris.nereids.trees.expressions.NamedExpression;
-import org.apache.doris.nereids.trees.expressions.Not;
import org.apache.doris.nereids.trees.expressions.Or;
import org.apache.doris.nereids.trees.expressions.ScalarSubquery;
import org.apache.doris.nereids.trees.expressions.SlotReference;
@@ -46,6 +42,7 @@ import
org.apache.doris.nereids.trees.plans.logical.LogicalFilter;
import org.apache.doris.nereids.trees.plans.logical.LogicalPlan;
import org.apache.doris.nereids.trees.plans.logical.LogicalProject;
+import com.google.common.base.Preconditions;
import com.google.common.collect.ImmutableList;
import com.google.common.collect.ImmutableSet;
@@ -196,7 +193,7 @@ public class SubqueryToApply implements AnalysisRuleFactory
{
subquery.getCorrelateSlots(),
subquery, Optional.empty(),
subqueryToMarkJoinSlot.get(subquery),
-mergeScalarSubConjectAndFilterConject(
+mergeScalarSubConjunctAndFilterConjunct(
subquery, subqueryCorrespondingConject,
conjunct, needAddSubOutputToProjects, singleSubquery),
isProject,
childPlan, subquery.getQueryPlan());
@@ -245,7 +242,7 @@ public class SubqueryToApply implements AnalysisRuleFactory
{
* LogicalJoin(otherConjunct[k2 = c2]) ---> inSub
* LogicalJoin(otherConjunct[k1 > sum(c1)]) ---> scalarSub
*/
-private Optional mergeScalarSubConjectAndFilterConject(
+private Optional mergeScalarSubConjunctAndFilterConjunct(
SubqueryExpr subquery,
Map subqueryCorrespondingConject,
Optional conjunct,
@@ -292,8 +289,20 @@ public class SubqueryToApply implements
AnalysisRuleFactory {
.collect(ImmutableSet.toImmutableSet());
}
-public Expression replace(Expression expressions, SubqueryContext
subqueryContext) {
-return expressions.accept(this, subqueryContext);
+public Expression replace(Expression expression, SubqueryContext
subqueryContext) {
+Expression replacedExpr = doReplace(expression, subqueryContext);
+if (subqueryContext.onlySingleSubquery() && !isMarkJoin) {
+// if there is only one subquery and it's not a mark join,
+// we can merge the filter with the join conjunct to eliminate
the filter node
+// to do that, we need update the subquery's corresponding
conjunct use replacedExpr
+// see mergeScalarSu
[GitHub] [doris] alanredsheep opened a new issue, #22339: [Enhancement] support gzip/bzip2 for hive catalog
alanredsheep opened a new issue, #22339: URL: https://github.com/apache/doris/issues/22339 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Description Doris ver: 1.2.6-rc03 Hive ver: 1.1.0 DataX hdfs-writer only support gzip/bzip2 for textfile table compression. Here is docs. https://github.com/alibaba/DataX/blob/master/hdfswriter/doc/hdfswriter.md But doris cannot read hive textfile table compressed by gzip. Here is the error message. ``` ERROR 1105 (HY000): errCode = 2, detailMessage = (xx.xx.xx.xx)[INTERNAL_ERROR]Only support csv data in utf8 codec ``` I used datax to collect data from mysql to hive, so there are so many textfile table compressed by gzip in Hive. So I really need Hive catalog support gzip/bzip2 compression. ### Solution This question is similar to another issus in https://github.com/apache/doris/pull/19387. This solution may to similar too. ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #21757: [fix](show-stmt) fix show create table missing storage_medium info
hello-stephen commented on PR #21757: URL: https://github.com/apache/doris/pull/21757#issuecomment-1655165633 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 47.55 seconds stream load tsv: 541 seconds loaded 74807831229 Bytes, about 131 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s insert into select: 29.2 seconds inserted 1000 Rows, about 342K ops/s storage size: 17167741910 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] alanredsheep commented on issue #22339: [Enhancement] support gzip/bzip2 for hive catalog
alanredsheep commented on issue #22339: URL: https://github.com/apache/doris/issues/22339#issuecomment-1655172933 @dutyu -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] kaijchen opened a new pull request, #22340: [test](regression) add partial update seq_col delete cases
kaijchen opened a new pull request, #22340: URL: https://github.com/apache/doris/pull/22340 ## Proposed changes Add regression cases for partial update delete with seq_col. ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] gohalo commented on pull request #20932: [fix](be) doris_be compile failed
gohalo commented on PR #20932: URL: https://github.com/apache/doris/pull/20932#issuecomment-1655181273 have no idea how to fix this complie failed problem  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] kaijchen commented on pull request #22340: [test](regression) add partial update seq_col delete cases
kaijchen commented on PR #22340: URL: https://github.com/apache/doris/pull/22340#issuecomment-1655181767 This should be merged after #22270 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] kaijchen commented on pull request #22340: [test](regression) add partial update seq_col delete cases
kaijchen commented on PR #22340: URL: https://github.com/apache/doris/pull/22340#issuecomment-1655186334 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22275: (vertical compaction) fix vertical compaction core
github-actions[bot] commented on PR #22275: URL: https://github.com/apache/doris/pull/22275#issuecomment-1655186492 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] jixxiong commented on pull request #22158: [improvement](stream-load) add http request field check for stream load in BE
jixxiong commented on PR #22158: URL: https://github.com/apache/doris/pull/22158#issuecomment-1655186595 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22275: (vertical compaction) fix vertical compaction core
github-actions[bot] commented on PR #22275: URL: https://github.com/apache/doris/pull/22275#issuecomment-1655186444 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangstar333 commented on pull request #22071: [Feature](count_by_enum) support count_by_enum function
zhangstar333 commented on PR #22071:
URL: https://github.com/apache/doris/pull/22071#issuecomment-1655189019
@czzmmc you could comment key words `run buildall` to trigger TeamCity.
ExpectRow: [[{"cbe":{"F":2,"M":3},"notnull":5,"null":0,"all":5}]]
RealRow: [[{"cbe":{"M":3,"F":2},"notnull":5,"null":0,"all":5}]]
and see the test result is unstable, maybe could add some string spit
function ?
I don't know this could help you eg: split_by_string(count_by_enum, ':')
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Jibing-Li commented on pull request #22338: [Improvement](multi catalog)Support Iceberg, Paimon and MaxCompute table in nereids.
Jibing-Li commented on PR #22338: URL: https://github.com/apache/doris/pull/22338#issuecomment-1655191768 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangstar333 commented on issue #18904: [Feature] Support batch operation for Java UDAF to get better performance
zhangstar333 commented on issue #18904: URL: https://github.com/apache/doris/issues/18904#issuecomment-1655192806 maybe in 2.0: https://github.com/apache/doris/pull/21388 https://github.com/apache/doris/pull/21713 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] vinlee19 commented on issue #22220: [Bug] The function array_intersect query result is incorrect
vinlee19 commented on issue #0: URL: https://github.com/apache/doris/issues/0#issuecomment-1655197010 We will fix the error in the documentation。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22338: [Improvement](multi catalog)Support Iceberg, Paimon and MaxCompute table in nereids.
github-actions[bot] commented on PR #22338: URL: https://github.com/apache/doris/pull/22338#issuecomment-1655203408 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22293: [enhancement](binlog) CreateTable inherit db binlog && Add some checks
hello-stephen commented on PR #22293: URL: https://github.com/apache/doris/pull/22293#issuecomment-1655203981 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 48.58 seconds stream load tsv: 525 seconds loaded 74807831229 Bytes, about 135 MB/s stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.4 seconds inserted 1000 Rows, about 340K ops/s storage size: 17169096749 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22329: [cherry-pick](branch-2.0) add partial update support for delete stmt in Nereids
github-actions[bot] commented on PR #22329: URL: https://github.com/apache/doris/pull/22329#issuecomment-1655205647 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22329: [cherry-pick](branch-2.0) add partial update support for delete stmt in Nereids
github-actions[bot] commented on PR #22329: URL: https://github.com/apache/doris/pull/22329#issuecomment-1655205696 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] XieJiann closed pull request #22277: [enhancement](Nereids) make maxBushyTree = 8
XieJiann closed pull request #22277: [enhancement](Nereids) make maxBushyTree = 8 URL: https://github.com/apache/doris/pull/22277 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] XieJiann closed pull request #21759: [feature](Nereids) support other join in DPHyper
XieJiann closed pull request #21759: [feature](Nereids) support other join in DPHyper URL: https://github.com/apache/doris/pull/21759 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] XieJiann closed pull request #21693: [enhancement](Nereids) Avoid frequent variable retrieval from connect context when calculating cost
XieJiann closed pull request #21693: [enhancement](Nereids) Avoid frequent variable retrieval from connect context when calculating cost URL: https://github.com/apache/doris/pull/21693 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22336: [Improvement] Add iceberg metadata cache and support manifest file content cache
hello-stephen commented on PR #22336: URL: https://github.com/apache/doris/pull/22336#issuecomment-1655211100 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 45.12 seconds stream load tsv: 536 seconds loaded 74807831229 Bytes, about 133 MB/s stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 28.9 seconds inserted 1000 Rows, about 346K ops/s storage size: 17168371807 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yujun777 commented on pull request #22317: [improvement](tablet clone) improve scaling out speed
yujun777 commented on PR #22317: URL: https://github.com/apache/doris/pull/22317#issuecomment-1655213178 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] vinlee19 opened a new pull request, #22341: [typo](docs) fix array_intersect function sample error
vinlee19 opened a new pull request, #22341: URL: https://github.com/apache/doris/pull/22341 ## Proposed changes Issue Number: close #xxx The result of array_intersect in the documentation example:  2.0-beta:  ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] vinlee19 commented on pull request #22341: [typo](docs) fix array_intersect function sample error
vinlee19 commented on PR #22341: URL: https://github.com/apache/doris/pull/22341#issuecomment-1655214282 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] AshinGau commented on pull request #22331: [fix](complex_type) throw error when reading complex types in broker/stream load
AshinGau commented on PR #22331: URL: https://github.com/apache/doris/pull/22331#issuecomment-1655219408 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] xzj7019 commented on pull request #22092: [enhance](nereids) enhance broadcast join cost calculation
xzj7019 commented on PR #22092: URL: https://github.com/apache/doris/pull/22092#issuecomment-1655227039 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22331: [fix](complex_type) throw error when reading complex types in broker/stream load
github-actions[bot] commented on PR #22331: URL: https://github.com/apache/doris/pull/22331#issuecomment-1655229927 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] wsjz opened a new pull request, #22342: [fix](multi-catalog)compatible with hdfs HA empty prefix
wsjz opened a new pull request, #22342: URL: https://github.com/apache/doris/pull/22342 ## Proposed changes compatible with hdfs HA empty prefix for example: ’hdfs:///‘ will be replaced to ’hdfs://ha-nameservice/‘ ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Jibing-Li opened a new pull request, #22343: [Fix](multi catalog statistics)Improve external table statistics collection. 22224
Jibing-Li opened a new pull request, #22343: URL: https://github.com/apache/doris/pull/22343 Improve external table statistics collection, including log, observability and fix some bugs. Add Running state for statistics job. Add progress for show analyze job. (n/m tasks finished, n/m task failed and so on) Add analyze time cost for show analyze task. Make task failure message more clear. Synchronize the job status updating code in updateTaskStatus. Fix NPE in HMSAnalyzeTask. (Avoid refreshing statistics cache if the collection sql failed) Return error message for with sync collection while timeout. Log level improvement Fix misuse of logCreateAnalysisJob for tasks. Cherry pick of master commit https://github.com/apache/doris/pull/4 ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zgxme commented on pull request #22071: [Feature](count_by_enum) support count_by_enum function
zgxme commented on PR #22071: URL: https://github.com/apache/doris/pull/22071#issuecomment-1655238058 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] deadlinefen commented on pull request #22314: [feature](property) Add table property "is_being_synced"
deadlinefen commented on PR #22314: URL: https://github.com/apache/doris/pull/22314#issuecomment-1655237900 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22158: [improvement](stream-load) add http request field check for stream load in BE
hello-stephen commented on PR #22158: URL: https://github.com/apache/doris/pull/22158#issuecomment-1655238658 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 46.6 seconds stream load tsv: 512 seconds loaded 74807831229 Bytes, about 139 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.3 seconds inserted 1000 Rows, about 341K ops/s storage size: 17163019695 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22338: [Improvement](multi catalog)Support Iceberg, Paimon and MaxCompute table in nereids.
hello-stephen commented on PR #22338: URL: https://github.com/apache/doris/pull/22338#issuecomment-1655238934 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 48.05 seconds stream load tsv: 504 seconds loaded 74807831229 Bytes, about 141 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.3 seconds inserted 1000 Rows, about 341K ops/s storage size: 17167706507 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22071: [Feature](count_by_enum) support count_by_enum function
hello-stephen commented on PR #22071: URL: https://github.com/apache/doris/pull/22071#issuecomment-1655239269 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 47.75 seconds stream load tsv: 507 seconds loaded 74807831229 Bytes, about 140 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 30.2 seconds inserted 1000 Rows, about 331K ops/s storage size: 17162661692 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris-website] jeffreys-cat opened a new pull request, #276: [feature](home) add newsletter
jeffreys-cat opened a new pull request, #276: URL: https://github.com/apache/doris-website/pull/276 - [feature](home) add newsletter -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhannngchen commented on a diff in pull request #22282: [Enhancement](merge-on-write) add correctness check for the calculation of delete bitmap
zhannngchen commented on code in PR #22282:
URL: https://github.com/apache/doris/pull/22282#discussion_r1277252109
##
be/src/olap/tablet_meta.h:
##
@@ -302,6 +303,10 @@ class DeleteBitmap {
using Version = uint64_t;
using BitmapKey = std::tuple;
std::map delete_bitmap; // Ordered map
+constexpr static inline uint32_t INVALID_SEGMENT_ID =
std::numeric_limits::max();
Review Comment:
use max()-1
##
be/src/olap/tablet_meta.h:
##
@@ -302,6 +303,10 @@ class DeleteBitmap {
using Version = uint64_t;
using BitmapKey = std::tuple;
std::map delete_bitmap; // Ordered map
+constexpr static inline uint32_t INVALID_SEGMENT_ID =
std::numeric_limits::max();
+constexpr static inline uint64_t INVALID_VERSION =
std::numeric_limits::max();
Review Comment:
use 0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] XieJiann commented on pull request #21936: [enhancement](Nereids): prune unuse plan in optimized group
XieJiann commented on PR #21936: URL: https://github.com/apache/doris/pull/21936#issuecomment-1655253301 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] XieJiann commented on pull request #22265: [fix](Nereids) fix ends calculation when there are constant project
XieJiann commented on PR #22265: URL: https://github.com/apache/doris/pull/22265#issuecomment-1655253857 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] HappenLee merged pull request #22205: [fix](executor) only mysql connect to set GlobalPipelineTask
HappenLee merged PR #22205: URL: https://github.com/apache/doris/pull/22205 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [fix](executor) only mysql connect to set GlobalPipelineTask (#22205)
This is an automated email from the ASF dual-hosted git repository.
lihaopeng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 25f26198f4 [fix](executor) only mysql connect to set
GlobalPipelineTask (#22205)
25f26198f4 is described below
commit 25f26198f4a9e5ebd3ba58a770b185f0818d7b18
Author: Mryange <59914473+mrya...@users.noreply.github.com>
AuthorDate: Fri Jul 28 16:19:34 2023 +0800
[fix](executor) only mysql connect to set GlobalPipelineTask (#22205)
---
fe/fe-core/src/main/java/org/apache/doris/qe/ConnectContext.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectContext.java
b/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectContext.java
index bc7b5273c3..1a1f5cda1f 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectContext.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/qe/ConnectContext.java
@@ -263,7 +263,7 @@ public class ConnectContext {
mysqlChannel = new DummyMysqlChannel();
}
sessionVariable = VariableMgr.newSessionVariable();
-if (isMajorVersionUpgrade) {
+if (connection != null && isMajorVersionUpgrade) {
VariableMgr.setGlobalPipelineTask(sessionVariable.parallelExecInstanceNum);
sessionVariable = VariableMgr.newSessionVariable();
}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] pingchunzhang commented on pull request #22287: [enhance](regresstion case)add external group mark 0727
pingchunzhang commented on PR #22287: URL: https://github.com/apache/doris/pull/22287#issuecomment-1655258964 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] xzj7019 commented on pull request #22092: [enhance](nereids) enhance broadcast join cost calculation
xzj7019 commented on PR #22092: URL: https://github.com/apache/doris/pull/22092#issuecomment-1655264228 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22317: [improvement](tablet clone) improve scaling out speed
hello-stephen commented on PR #22317: URL: https://github.com/apache/doris/pull/22317#issuecomment-1655271623 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 45.8 seconds stream load tsv: 508 seconds loaded 74807831229 Bytes, about 140 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.0 seconds inserted 1000 Rows, about 344K ops/s storage size: 17166876425 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] wsjz commented on pull request #22342: [fix](multi-catalog)compatible with hdfs HA empty prefix
wsjz commented on PR #22342: URL: https://github.com/apache/doris/pull/22342#issuecomment-1655275283 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22314: [feature](property) Add table property "is_being_synced"
hello-stephen commented on PR #22314: URL: https://github.com/apache/doris/pull/22314#issuecomment-1655277478 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 48.75 seconds stream load tsv: 509 seconds loaded 74807831229 Bytes, about 140 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 71 seconds loaded 1101869774 Bytes, about 14 MB/s stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s insert into select: 29.3 seconds inserted 1000 Rows, about 341K ops/s storage size: 17162705972 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22092: [enhance](nereids) enhance broadcast join cost calculation
hello-stephen commented on PR #22092: URL: https://github.com/apache/doris/pull/22092#issuecomment-1655277966 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 48.09 seconds stream load tsv: 508 seconds loaded 74807831229 Bytes, about 140 MB/s stream load json: 37 seconds loaded 2358488459 Bytes, about 60 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.6 seconds inserted 1000 Rows, about 337K ops/s storage size: 17169345178 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22331: [fix](complex_type) throw error when reading complex types in broker/stream load
hello-stephen commented on PR #22331: URL: https://github.com/apache/doris/pull/22331#issuecomment-1655278678 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 41.31 seconds stream load tsv: 506 seconds loaded 74807831229 Bytes, about 140 MB/s stream load json: 29 seconds loaded 2358488459 Bytes, about 77 MB/s stream load orc: 72 seconds loaded 1101869774 Bytes, about 14 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.3 seconds inserted 1000 Rows, about 341K ops/s storage size: 17162657493 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22300: [vectorized](udf) java udf support with return map type
github-actions[bot] commented on PR #22300: URL: https://github.com/apache/doris/pull/22300#issuecomment-1655282116 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22300: [vectorized](udf) java udf support with return map type
github-actions[bot] commented on PR #22300: URL: https://github.com/apache/doris/pull/22300#issuecomment-1655282182 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dataroaring merged pull request #22275: (vertical compaction) fix vertical compaction core
dataroaring merged PR #22275: URL: https://github.com/apache/doris/pull/22275 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: (vertical compaction) fix vertical compaction core (#22275)
This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new ec1a4d172b (vertical compaction) fix vertical compaction core (#22275)
ec1a4d172b is described below
commit ec1a4d172b564c2721e4989ec222a3a7d1e69a22
Author: huanghaibin <284824...@qq.com>
AuthorDate: Fri Jul 28 16:41:00 2023 +0800
(vertical compaction) fix vertical compaction core (#22275)
* (vertical compaction) fix vertical compaction core
co-author:@zhannngchen
---
be/src/olap/rowset/vertical_beta_rowset_writer.cpp | 25 --
be/src/olap/rowset/vertical_beta_rowset_writer.h | 9 ++--
be/src/vec/olap/vertical_block_reader.cpp | 57 +++---
be/src/vec/olap/vertical_block_reader.h| 8 ++-
be/src/vec/olap/vertical_merge_iterator.cpp| 31 +---
be/src/vec/olap/vertical_merge_iterator.h | 4 ++
be/test/vec/olap/vertical_compaction_test.cpp | 28 ---
7 files changed, 132 insertions(+), 30 deletions(-)
diff --git a/be/src/olap/rowset/vertical_beta_rowset_writer.cpp
b/be/src/olap/rowset/vertical_beta_rowset_writer.cpp
index e7639a516f..4ae2ee017f 100644
--- a/be/src/olap/rowset/vertical_beta_rowset_writer.cpp
+++ b/be/src/olap/rowset/vertical_beta_rowset_writer.cpp
@@ -99,19 +99,33 @@ Status VerticalBetaRowsetWriter::add_columns(const
vectorized::Block* block,
uint32_t num_rows_written =
_segment_writers[_cur_writer_idx]->num_rows_written();
VLOG_NOTICE << "num_rows_written: " << num_rows_written
<< ", _cur_writer_idx: " << _cur_writer_idx;
+uint32_t num_rows_key_group =
_segment_writers[_cur_writer_idx]->row_count();
// init if it's first value column write in current segment
if (_cur_writer_idx == 0 && num_rows_written == 0) {
VLOG_NOTICE << "init first value column segment writer";
RETURN_IF_ERROR(_segment_writers[_cur_writer_idx]->init(col_ids,
is_key));
}
-if (num_rows_written > max_rows_per_segment) {
+// when splitting segment, need to make rows align between key columns
and value columns
+size_t start_offset = 0, limit = num_rows;
+if (num_rows_written + num_rows >= num_rows_key_group &&
+_cur_writer_idx < _segment_writers.size() - 1) {
+RETURN_IF_ERROR(_segment_writers[_cur_writer_idx]->append_block(
+block, 0, num_rows_key_group - num_rows_written));
RETURN_IF_ERROR(_flush_columns(&_segment_writers[_cur_writer_idx]));
-// switch to next writer
+start_offset = num_rows_key_group - num_rows_written;
+limit = num_rows - start_offset;
++_cur_writer_idx;
-VLOG_NOTICE << "init next value column segment writer: " <<
_cur_writer_idx;
+// switch to next writer
RETURN_IF_ERROR(_segment_writers[_cur_writer_idx]->init(col_ids,
is_key));
+num_rows_written = 0;
+num_rows_key_group =
_segment_writers[_cur_writer_idx]->row_count();
+}
+if (limit > 0) {
+RETURN_IF_ERROR(
+_segment_writers[_cur_writer_idx]->append_block(block,
start_offset, limit));
+DCHECK(_segment_writers[_cur_writer_idx]->num_rows_written() <=
+ _segment_writers[_cur_writer_idx]->row_count());
}
-RETURN_IF_ERROR(_segment_writers[_cur_writer_idx]->append_block(block,
0, num_rows));
}
if (is_key) {
_num_rows_written += num_rows;
@@ -126,6 +140,7 @@ Status VerticalBetaRowsetWriter::_flush_columns(
RETURN_IF_ERROR((*segment_writer)->finalize_columns_data());
RETURN_IF_ERROR((*segment_writer)->finalize_columns_index(&index_size));
if (is_key) {
+_total_key_group_rows += (*segment_writer)->row_count();
// record segment key bound
KeyBoundsPB key_bounds;
Slice min_key = (*segment_writer)->min_encoded_key();
@@ -147,7 +162,7 @@ Status VerticalBetaRowsetWriter::flush_columns(bool is_key)
{
return Status::OK();
}
-DCHECK(_segment_writers[_cur_writer_idx]);
+DCHECK(_cur_writer_idx < _segment_writers.size() &&
_segment_writers[_cur_writer_idx]);
RETURN_IF_ERROR(_flush_columns(&_segment_writers[_cur_writer_idx],
is_key));
_cur_writer_idx = 0;
return Status::OK();
diff --git a/be/src/olap/rowset/vertical_beta_rowset_writer.h
b/be/src/olap/rowset/vertical_beta_rowset_writer.h
index 71b132b9b4..8e318686db 100644
--- a/be/src/olap/rowset/vertical_beta_rowset_writer.h
+++ b/be/src/olap/rowset/vertical_beta_rowset_writer.h
@@ -39,13 +39,15 @@ public:
~VerticalBetaRowsetWriter();
Status add_columns(const vectorized::Block* block, const
std::vector& col_ids,
- bool is_key, ui
[GitHub] [doris] wuwenchi opened a new pull request, #22344: [fix] [doc] fix command misspelling
wuwenchi opened a new pull request, #22344: URL: https://github.com/apache/doris/pull/22344 ## Proposed changes `show backend` > `show backends` ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dataroaring commented on pull request #22293: [enhancement](binlog) CreateTable inherit db binlog && Add some checks
dataroaring commented on PR #22293: URL: https://github.com/apache/doris/pull/22293#issuecomment-1655296608 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22344: [fix] [doc] fix command misspelling
github-actions[bot] commented on PR #22344: URL: https://github.com/apache/doris/pull/22344#issuecomment-1655300505 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangstar333 opened a new pull request, #22345: [cherry-pick](flex) support scientific notation(aEb) parser
zhangstar333 opened a new pull request, #22345: URL: https://github.com/apache/doris/pull/22345 ## Proposed changes pick from master https://github.com/apache/doris/pull/22248 Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] gohalo commented on issue #20931: [Bug] Compile be failed with undefined reference on master branch.
gohalo commented on issue #20931: URL: https://github.com/apache/doris/issues/20931#issuecomment-1655314717 got what's your mean now, the abseil's headers is conflict with opentelemetry's.  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22265: [fix](Nereids) fix ends calculation when there are constant project
hello-stephen commented on PR #22265: URL: https://github.com/apache/doris/pull/22265#issuecomment-1655317750 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 47.21 seconds stream load tsv: 503 seconds loaded 74807831229 Bytes, about 141 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.6 seconds inserted 1000 Rows, about 337K ops/s storage size: 17170988047 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] bobhan1 commented on pull request #22282: [Enhancement](merge-on-write) add correctness check for the calculation of delete bitmap
bobhan1 commented on PR #22282: URL: https://github.com/apache/doris/pull/22282#issuecomment-1655322699 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22092: [enhance](nereids) enhance broadcast join cost calculation
hello-stephen commented on PR #22092: URL: https://github.com/apache/doris/pull/22092#issuecomment-1655323788 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 46.47 seconds stream load tsv: 504 seconds loaded 74807831229 Bytes, about 141 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s insert into select: 29.2 seconds inserted 1000 Rows, about 342K ops/s storage size: 17170450393 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt opened a new pull request, #22346: [Bug](planner) add expr valid check on aggregation node
BiteThet opened a new pull request, #22346: URL: https://github.com/apache/doris/pull/22346 ## Proposed changes ```sql mysql [regression_test_nereids_p0_aggregate]>explain select k2, max(k3) from t group by k3; ERROR 1105 (HY000): AnalysisException, msg: Input slot(s) not in child's output: k2#1 in plan: LogicalProject[73] ( distinct=false, projects=[k2#1, max(k3)#4], excepts=[], canEliminate=true ), child output is: [k3#2, max(k3)#4] ``` ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt commented on pull request #22346: [Bug](planner) add expr valid check on aggregation node
BiteThet commented on PR #22346: URL: https://github.com/apache/doris/pull/22346#issuecomment-1655325150 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22342: [fix](multi-catalog)compatible with hdfs HA empty prefix
hello-stephen commented on PR #22342: URL: https://github.com/apache/doris/pull/22342#issuecomment-1655325447 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 46.98 seconds stream load tsv: 508 seconds loaded 74807831229 Bytes, about 140 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s insert into select: 30.2 seconds inserted 1000 Rows, about 331K ops/s storage size: 17168658071 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt merged pull request #22232: [fix](case) add sync after stream load
BiteThet merged PR #22232: URL: https://github.com/apache/doris/pull/22232 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [fix](case) add sync after stream load (#22232)
This is an automated email from the ASF dual-hosted git repository.
panxiaolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new ef218d79da [fix](case) add sync after stream load (#22232)
ef218d79da is described below
commit ef218d79da57d94667031c82964800023c9930b0
Author: shuke <37901441+shuke...@users.noreply.github.com>
AuthorDate: Fri Jul 28 17:05:20 2023 +0800
[fix](case) add sync after stream load (#22232)
add sync after stream load
---
.../duplicate/storage/test_dup_tab_auto_inc_with_null.groovy | 3 ++-
regression-test/suites/load_p0/mysql_load/test_mysql_load.groovy | 3 ++-
.../suites/partition_p0/multi_partition/test_range_partition.groovy| 1 +
3 files changed, 5 insertions(+), 2 deletions(-)
diff --git
a/regression-test/suites/data_model_p0/duplicate/storage/test_dup_tab_auto_inc_with_null.groovy
b/regression-test/suites/data_model_p0/duplicate/storage/test_dup_tab_auto_inc_with_null.groovy
index 14568db2a5..f56b212109 100644
---
a/regression-test/suites/data_model_p0/duplicate/storage/test_dup_tab_auto_inc_with_null.groovy
+++
b/regression-test/suites/data_model_p0/duplicate/storage/test_dup_tab_auto_inc_with_null.groovy
@@ -45,6 +45,7 @@ suite("test_dup_table_auto_inc_basic_with_null") {
file 'auto_inc_basic_with_null.csv'
time 1 // limit inflight 10s
}
+sql """sync"""
qt_auto_inc_ids "select * from ${table1};"
sql "drop table if exists ${table1};"
@@ -228,4 +229,4 @@ suite("test_dup_table_auto_inc_basic_with_null") {
"""
sql "insert into ${table8} select x, null from ${table7};"
qt_sql "select * from ${table8} order by id"
-}
\ No newline at end of file
+}
diff --git a/regression-test/suites/load_p0/mysql_load/test_mysql_load.groovy
b/regression-test/suites/load_p0/mysql_load/test_mysql_load.groovy
index 611adf9e3a..ff239e5fef 100644
--- a/regression-test/suites/load_p0/mysql_load/test_mysql_load.groovy
+++ b/regression-test/suites/load_p0/mysql_load/test_mysql_load.groovy
@@ -153,7 +153,8 @@ suite("test_mysql_load", "p0") {
(col)
SET
(k1=year(col),k2=month(col),k3=month(col),k4=day(col),k5=7.7,k6="a",k10=date(col),k11=FROM_UNIXTIME(2019,"%Y-%m-%dT%H:%i:%s"),k7="k7",k8=month(col),k9=day(col));
"""
-
+
+sql "sync"
order_qt_sql1 " SELECT * FROM ${tableName2}"
}
diff --git
a/regression-test/suites/partition_p0/multi_partition/test_range_partition.groovy
b/regression-test/suites/partition_p0/multi_partition/test_range_partition.groovy
index 02f5f1b55b..e456869058 100644
---
a/regression-test/suites/partition_p0/multi_partition/test_range_partition.groovy
+++
b/regression-test/suites/partition_p0/multi_partition/test_range_partition.groovy
@@ -68,6 +68,7 @@ suite("test_range_partition", "p0") {
set "column_separator", ","
file "partition_table.csv"
}
+sql """sync"""
test {
sql "select * from tinyint_partition_tb_${idx} order by k1, k2"
resultFile "partition_table.out"
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hubgeter opened a new pull request, #22347: Hive map struct
hubgeter opened a new pull request, #22347:
URL: https://github.com/apache/doris/pull/22347
## Proposed changes
Issue Number: close #xxx
after pr #21514
1. append support for struct and map column type on textfile format of hive
table.
2. optimizer code that array column type.
```mysql
+--++
| id | perf |
+--++
| 1| {"key1":"value1", "key2":"value2"} |
| 1| {"key1":"value1", "key2":"value2"} |
| 2| {"name":"John", "age":"30"}|
+--++
```
```mysql
+-+--+
| column1 | column2 |
+-+--+
| 1 | {10, "data1", 1} |
| 2 | {20, "data2", 0} |
| 3 | {30, "data3", 1} |
+-+--+
```
Summarizes support for complex types(support assign delimiter) :
1. array< primitive_type > and array< array< ... > >
2. map< primitive_type , primitive_type >
3. Struct< primitive_type , primitive_type ... >
## Further comments
If this is a relatively large or complex change, kick off the discussion at
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you
chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22282: [Enhancement](merge-on-write) add correctness check for the calculation of delete bitmap
github-actions[bot] commented on PR #22282: URL: https://github.com/apache/doris/pull/22282#issuecomment-1655341080 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yiguolei merged pull request #22287: [enhance](regresstion case)add external group mark 0727
yiguolei merged PR #22287: URL: https://github.com/apache/doris/pull/22287 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated (ef218d79da -> 3eeca7ee55)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from ef218d79da [fix](case) add sync after stream load (#22232)
add 3eeca7ee55 [enhance](regresstion case)add external group mark 0727
(#22287)
No new revisions were added by this update.
Summary of changes:
.github/workflows/auto_trigger_teamcity.yml | 5 -
docker/thirdparties/run-thirdparties-docker.sh| 2 +-
regression-test/pipeline/{p1 => external}/conf/be.conf| 0
regression-test/pipeline/{p1 => external}/conf/fe.conf| 0
.../pipeline/external/conf}/odbcinst.ini | 0
.../pipeline/{p0 => external}/conf/regression-conf.groovy | 15 ---
regression-test/pipeline/p0/conf/regression-conf.groovy | 5 +
.../table_valued_function/test_hdfs_tvf.groovy| 2 +-
regression-test/suites/es_p0/test_es_query.groovy | 2 +-
.../suites/external_catalog_p0/hive/test_hive_orc.groovy | 2 +-
.../external_catalog_p0/hive/test_hive_other.groovy | 2 +-
.../external_catalog_p0/hive/test_hive_parquet.groovy | 2 +-
.../external_catalog_p0/hive/test_hive_partitions.groovy | 2 +-
.../hive/test_hive_schema_evolution.groovy| 2 +-
.../suites/jdbc_catalog_p0/test_mysql_jdbc_catalog.groovy | 2 +-
.../suites/jdbc_catalog_p0/test_pg_jdbc_catalog.groovy| 2 +-
.../suites/jdbc_p0/test_jdbc_query_mysql.groovy | 2 +-
regression-test/suites/jdbc_p0/test_jdbc_query_pg.groovy | 2 +-
.../suites/load_p0/stream_load/test_hdfs_json_load.groovy | 2 +-
.../load_p0/stream_load/test_load_with_decimal.groovy | 2 +-
.../suites/nereids_p0/show/test_show_where.groovy | 2 +-
.../suites/query_p0/show/test_show_where.groovy | 2 +-
.../multi_catalog_query/hive_catalog_orc.groovy | 2 +-
.../multi_catalog_query/hive_catalog_parquet.groovy | 2 +-
24 files changed, 39 insertions(+), 22 deletions(-)
copy regression-test/pipeline/{p1 => external}/conf/be.conf (100%)
copy regression-test/pipeline/{p1 => external}/conf/fe.conf (100%)
copy {conf => regression-test/pipeline/external/conf}/odbcinst.ini (100%)
copy regression-test/pipeline/{p0 => external}/conf/regression-conf.groovy
(93%)
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22347: [feature](hive)append support for struct and map column type on textfile format of hive table
github-actions[bot] commented on PR #22347: URL: https://github.com/apache/doris/pull/22347#issuecomment-1655351314 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] czzmmc commented on pull request #22071: [Feature](count_by_enum) support count_by_enum function
czzmmc commented on PR #22071: URL: https://github.com/apache/doris/pull/22071#issuecomment-1655352039 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] KassieZ opened a new pull request, #22348: [Docs](Community) Delete Gitter Mannual of EN & CN Verison
KassieZ opened a new pull request, #22348: URL: https://github.com/apache/doris/pull/22348 ## Proposed changes Issue Number: close #xxx ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] czzmmc commented on pull request #22071: [Feature](count_by_enum) support count_by_enum function
czzmmc commented on PR #22071: URL: https://github.com/apache/doris/pull/22071#issuecomment-1655352888 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] KassieZ commented on pull request #22348: [Docs](Community) Delete Gitter Mannual of EN & CN Verison
KassieZ commented on PR #22348: URL: https://github.com/apache/doris/pull/22348#issuecomment-1655352942 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22314: [feature](property) Add table property "is_being_synced"
github-actions[bot] commented on PR #22314: URL: https://github.com/apache/doris/pull/22314#issuecomment-1655358223 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] adonis0147 commented on pull request #22344: [fix] [doc] fix command misspelling
adonis0147 commented on PR #22344: URL: https://github.com/apache/doris/pull/22344#issuecomment-1655359103 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22344: [fix] [doc] fix command misspelling
github-actions[bot] commented on PR #22344: URL: https://github.com/apache/doris/pull/22344#issuecomment-1655360234 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22071: [Feature](count_by_enum) support count_by_enum function
github-actions[bot] commented on PR #22071: URL: https://github.com/apache/doris/pull/22071#issuecomment-1655362332 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yiguolei merged pull request #22345: [cherry-pick](flex) support scientific notation(aEb) parser
yiguolei merged PR #22345: URL: https://github.com/apache/doris/pull/22345 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch branch-1.2-lts updated: [cherry-pick](flex) support scientific notation(aEb) parser (#22345)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-1.2-lts
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-1.2-lts by this push:
new f5aa4f91fa [cherry-pick](flex) support scientific notation(aEb) parser
(#22345)
f5aa4f91fa is described below
commit f5aa4f91fab139ae697a9d421f6852941d5c4a7f
Author: zhangstar333 <87313068+zhangstar...@users.noreply.github.com>
AuthorDate: Fri Jul 28 17:24:26 2023 +0800
[cherry-pick](flex) support scientific notation(aEb) parser (#22345)
---
fe/fe-core/src/main/jflex/sql_scanner.flex | 14 +-
1 file changed, 13 insertions(+), 1 deletion(-)
diff --git a/fe/fe-core/src/main/jflex/sql_scanner.flex
b/fe/fe-core/src/main/jflex/sql_scanner.flex
index 597c23eec1..52dcdd5e8d 100644
--- a/fe/fe-core/src/main/jflex/sql_scanner.flex
+++ b/fe/fe-core/src/main/jflex/sql_scanner.flex
@@ -597,7 +597,8 @@ FLit1 = [0-9]+ \. [0-9]*
FLit2 = \. [0-9]+
FLit3 = [0-9]+
Exponent = [eE] [+-]? [0-9]+
-DoubleLiteral = ({FLit1}|{FLit2}|{FLit3}) {Exponent}?
+DoubleLiteral = ({FLit1}|{FLit2}|{FLit3})
+ExponentLiteral = ({FLit1}|{FLit2}|{FLit3}) {Exponent}
EolHintBegin = "--" " "* "+"
CommentedHintBegin = "/*" " "* "+"
@@ -656,6 +657,17 @@ EndOfLineComment = "--"
!({HintContent}|{ContainsLineTerminator}) {LineTerminato
"'" { return newToken(SqlParserSymbols.UNMATCHED_STRING_LITERAL, null); }
"`" { return newToken(SqlParserSymbols.UNMATCHED_STRING_LITERAL, null); }
+{ExponentLiteral} {
+ BigDecimal decimal_val;
+ try {
+ decimal_val = new BigDecimal(yytext());
+ } catch (NumberFormatException e) {
+ return newToken(SqlParserSymbols.NUMERIC_OVERFLOW, yytext());
+ }
+
+ return newToken(SqlParserSymbols.DECIMAL_LITERAL, decimal_val);
+ }
+
{QuotedIdentifier} {
// Remove the quotes
String trimmedIdent = yytext().substring(1, yytext().length() - 1);
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #22293: [enhancement](binlog) CreateTable inherit db binlog && Add some checks
hello-stephen commented on PR #22293: URL: https://github.com/apache/doris/pull/22293#issuecomment-1655368248 (From new machine)TeamCity pipeline, clickbench performance test result: the sum of best hot time: 47.01 seconds stream load tsv: 508 seconds loaded 74807831229 Bytes, about 140 MB/s stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s insert into select: 29.2 seconds inserted 1000 Rows, about 342K ops/s storage size: 17168271007 Bytes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22115: [opt](hive)opt select count(*) stmt push down agg on parquet in hive .
github-actions[bot] commented on PR #22115: URL: https://github.com/apache/doris/pull/22115#issuecomment-1655368855 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22333: Local tvf
github-actions[bot] commented on PR #22333: URL: https://github.com/apache/doris/pull/22333#issuecomment-1655368834 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22340: [test](regression) add partial update seq_col delete cases
github-actions[bot] commented on PR #22340: URL: https://github.com/apache/doris/pull/22340#issuecomment-1655369266 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22340: [test](regression) add partial update seq_col delete cases
github-actions[bot] commented on PR #22340: URL: https://github.com/apache/doris/pull/22340#issuecomment-1655369338 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22152: [Chore](refactor) remove some unused code
github-actions[bot] commented on PR #22152: URL: https://github.com/apache/doris/pull/22152#issuecomment-1655369417 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #22152: [Chore](refactor) remove some unused code
github-actions[bot] commented on PR #22152: URL: https://github.com/apache/doris/pull/22152#issuecomment-1655369464 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] czzmmc commented on pull request #22071: [Feature](count_by_enum) support count_by_enum function
czzmmc commented on PR #22071: URL: https://github.com/apache/doris/pull/22071#issuecomment-1655369929 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated (3eeca7ee55 -> 05abfbc5ef)
This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 3eeca7ee55 [enhance](regresstion case)add external group mark 0727
(#22287)
add 05abfbc5ef [improvement](regression-test) add compression algorithm
regression test (#22303)
No new revisions were added by this update.
Summary of changes:
.../apache/doris/common/util/PropertyAnalyzer.java | 2 +
gensrc/thrift/AgentService.thrift | 3 +-
regression-test/data/compression_p0/load.csv | 5 +
regression-test/data/compression_p0/load.out | 43 +++
.../snappy => compression_p1}/ipv4.csv | 0
.../suites/compress_p1/snappy/load.groovy | 45 ---
regression-test/suites/compression_p0/load.groovy | 335 +
regression-test/suites/compression_p1/load.groovy | 179 +++
8 files changed, 566 insertions(+), 46 deletions(-)
create mode 100644 regression-test/data/compression_p0/load.csv
create mode 100644 regression-test/data/compression_p0/load.out
rename regression-test/data/{compress_p1/snappy => compression_p1}/ipv4.csv
(100%)
delete mode 100644 regression-test/suites/compress_p1/snappy/load.groovy
create mode 100644 regression-test/suites/compression_p0/load.groovy
create mode 100644 regression-test/suites/compression_p1/load.groovy
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dataroaring merged pull request #22303: [improvement](regression-test) add compression algorithm regression test
dataroaring merged PR #22303: URL: https://github.com/apache/doris/pull/22303 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
