Re: [PR] [fix](restore) Reset ids for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33831:
URL: https://github.com/apache/doris/pull/33831#issuecomment-2063160829

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](restore) Reset ids for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


w41ter opened a new pull request, #33831:
URL: https://github.com/apache/doris/pull/33831

   ## Proposed changes
   
   Issue Number: close #xxx
   
   The index id in MaterializedIndexMeta is not reset during restoration.  This 
PR fixes it and reset the wrong index id in the OlapTable.readFields.
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Pick](nerids) pick #33010 #32982 #33531 to branch 2.1 [doris]

2024-04-18 Thread via GitHub


englefly commented on PR #33829:
URL: https://github.com/apache/doris/pull/33829#issuecomment-2063161333

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](restore) Reset ids for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


w41ter commented on PR #33831:
URL: https://github.com/apache/doris/pull/33831#issuecomment-2063161451

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](workflow) Increase the build space for building third-party libraries (#22322) [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33832:
URL: https://github.com/apache/doris/pull/33832#issuecomment-2063161621

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [chore](workflow) Increase the build space for building third-party libraries (#22322) [doris]

2024-04-18 Thread via GitHub


adonis0147 opened a new pull request, #33832:
URL: https://github.com/apache/doris/pull/33832

   ## Proposed changes
   
   ~~Issue Number: close #xxx~~
   
   Backport #22322 .
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Feature](top-n) support topn filter on vscan node [doris]

2024-04-18 Thread via GitHub


BiteThet commented on PR #33496:
URL: https://github.com/apache/doris/pull/33496#issuecomment-2063166204

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [bugfix](hive)delete write path after hive insert [doris]

2024-04-18 Thread via GitHub


wuwenchi commented on PR #33798:
URL: https://github.com/apache/doris/pull/33798#issuecomment-2063171162

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](workflow) Increase the build space for building third-party libraries (#22322) [doris]

2024-04-18 Thread via GitHub


adonis0147 commented on PR #33832:
URL: https://github.com/apache/doris/pull/33832#issuecomment-2063170534

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](Words) Fix some incorrect words [doris]

2024-04-18 Thread via GitHub


GoGoWen commented on PR #33821:
URL: https://github.com/apache/doris/pull/33821#issuecomment-2063170714

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix]delete error docs [doris-website]

2024-04-18 Thread via GitHub


ixzc opened a new pull request, #570:
URL: https://github.com/apache/doris-website/pull/570

   This feature is currently not supported and should not be included in the 
2.0 documentation


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [func](jsonb)support json_depth function [doris]

2024-04-18 Thread via GitHub


LemonLiTree commented on PR #24801:
URL: https://github.com/apache/doris/pull/24801#issuecomment-2063181146

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhancement](function) Support Overlay function [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33243:
URL: https://github.com/apache/doris/pull/33243#issuecomment-2063175658

   TeamCity be ut coverage result:
Function Coverage: 35.44% (8918/25164) 
Line Coverage: 27.14% (73290/270057)
Region Coverage: 26.26% (37855/144138)
Branch Coverage: 23.06% (19288/83626)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/c89acaecba6f12b33a469f3f4a362d375fe0866f_c89acaecba6f12b33a469f3f4a362d375fe0866f/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement] (plsql) support show procedure status filters [doris]

2024-04-18 Thread via GitHub


xinyiZzz commented on code in PR #33264:
URL: https://github.com/apache/doris/pull/33264#discussion_r1570128389


##
fe/fe-core/src/main/java/org/apache/doris/plsql/functions/DorisFunctionRegistry.java:
##
@@ -89,15 +92,62 @@ private String qualified(String name) {
 return (ConnectContext.get().getDatabase() + "." + name).toUpperCase();
 }
 
+private String getDbName(long catalogId, long dbId) {
+String dbName = "";
+CatalogIf catalog = 
Env.getCurrentEnv().getCatalogMgr().getCatalog(catalogId);
+if (catalog != null) {
+DatabaseIf db = catalog.getDbNullable(dbId);
+if (db != null) {
+dbName = db.getFullName();
+}
+}
+return dbName;
+}
+
+public static boolean like(String str, String expr) {
+expr = expr.toLowerCase();
+expr = expr.replace(".", "\\.");
+expr = expr.replace("?", ".");
+expr = expr.replace("%", ".*");
+str = str.toLowerCase();
+return str.matches(expr);
+}
+
+public boolean applyProcFilter(String value, String filter) {
+if (filter.isEmpty()) {
+return true;
+}
+if (filter.contains("%")) {
+return like(value, filter);
+}
+if (value.equals(filter)) {
+return true;
+}
+return false;
+}
+
 @Override
-public void showProcedure(List> columns) {
+public void showProcedure(List> columns, String dbFilter, 
String procFilter, String likeFilter) {
 Map allProc = 
client.getAllPlsqlStoredProcedures();
 for (Map.Entry entry : 
allProc.entrySet()) {
 List row = new ArrayList<>();
 PlsqlStoredProcedure proc = entry.getValue();
+if (!applyProcFilter(proc.getName(), procFilter)) {
+continue;
+}
+String dbName = getDbName(proc.getCatalogId(), proc.getDbId());
+if (!dbFilter.isEmpty()
+&& !dbName.equals(dbFilter)) {
+continue;
+}
+if (!likeFilter.isEmpty()
+&& !like(proc.getName(), likeFilter)) {

Review Comment:
   ignore this comment, currently difficult to implement general expression 
filter behind `show stmt where`.
   
   your code to parse the filter is ok.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](restore) Reset ids for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


w41ter commented on PR #33831:
URL: https://github.com/apache/doris/pull/33831#issuecomment-2063181427

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement] (plsql) support show procedure status filters [doris]

2024-04-18 Thread via GitHub


xinyiZzz commented on code in PR #33264:
URL: https://github.com/apache/doris/pull/33264#discussion_r1570138914


##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowProcedureStatusCommand.java:
##
@@ -59,10 +72,74 @@ public ShowResultSetMetaData getMetaData() {
 return builder.build();
 }
 
+private String extractFilterValue(PartitionColumnFilter colFilter) {
+
+InPredicate inPredicate = colFilter.getInPredicate();
+if (null == inPredicate) {
+// equal one value
+if (colFilter.lowerBoundInclusive && colFilter.upperBoundInclusive
+&& colFilter.lowerBound != null && colFilter.upperBound != 
null
+&& 0 == 
colFilter.lowerBound.compareLiteral(colFilter.upperBound)) {
+return colFilter.lowerBound.getStringValue();
+}
+}
+throw new AnalysisException("Only supports equalTo and Like in filter 
for whereClause");
+}
+
+private void validateAndExtractFilters(StringBuilder dbFilter, 
StringBuilder procFilter) throws Exception {
+Map filterMap = Maps.newHashMap();
+if (!this.whereExpr.isEmpty()) {
+
whereExpr.stream().map(ExpressionUtils::checkAndMaybeCommute).filter(Optional::isPresent)
+.forEach(expr -> new 
ExpressionColumnFilterConverter(filterMap).convert(expr.get()));
+}
+// we support filter on Db and Name and ProcedureName.
+// But one column we can put only once and support conjucts
+for (Map.Entry elem : 
filterMap.entrySet()) {
+String columnName = elem.getKey();
+if ((!columnName.equals("Db"))
+&& (!columnName.equals("Name"))
+&& (!columnName.equals("ProcedureName"))) {
+throw new AnalysisException("Only supports filter Db, Name, 
ProcedureName with equalTo or LIKE");
+}
+if (columnName.equals("Db")) {
+if (dbFilter.length() != 0) {
+throw new AnalysisException("Only supports filter Db only 
1 time in where clause");
+}
+dbFilter.append(extractFilterValue(elem.getValue()));
+} else if ((columnName.equals("Name"))
+|| (columnName.equals("ProcedureName"))) {
+if (procFilter.length() != 0) {
+throw new AnalysisException("Only supports filter 
Name/ProcedureName only 1 time in where clause");
+}
+procFilter.append(extractFilterValue(elem.getValue()));
+}
+}
+}
+
+private String extractLikeFilter() {
+String likeFilter = "";
+if (this.valueExpr == null) {
+return likeFilter;
+}
+Map filterMap = Maps.newHashMap();
+new ExpressionColumnFilterConverter(filterMap)
+.convert(this.valueExpr);
+for (Map.Entry elem : 
filterMap.entrySet()) {
+likeFilter = extractFilterValue(elem.getValue());

Review Comment:
   > this class is use for bucket prune. should not change anything about it
   
   morrySnow means that `ExpressionColumnFilterConverter` cannot be modified.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [bugfix](paimon) Create paimon catalog with hadoop user [doris]

2024-04-18 Thread via GitHub


wuwenchi opened a new pull request, #33833:
URL: https://github.com/apache/doris/pull/33833

   ## Proposed changes
   
   When creating a catalog, paimon will create a warehouse on HDFS, so we need 
to use the corresponding user with permissions to create it.
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](compile) fix two compile errors on MacOS [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33834:
URL: https://github.com/apache/doris/pull/33834#issuecomment-2063189014

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [bugfix](paimon) Create paimon catalog with hadoop user [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33833:
URL: https://github.com/apache/doris/pull/33833#issuecomment-2063188761

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](compile) fix two compile errors on MacOS [doris]

2024-04-18 Thread via GitHub


morrySnow opened a new pull request, #33834:
URL: https://github.com/apache/doris/pull/33834

   1. MacOS use libhdfs3, so we need call different function. 
   this compile error intro by PR #33680
   
   2. size_t is not UInt64 on MacOS.
   this compile error intro by PR #33265
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement] (plsql) support show procedure status filters [doris]

2024-04-18 Thread via GitHub


Vallishp commented on code in PR #33264:
URL: https://github.com/apache/doris/pull/33264#discussion_r1570140817


##
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowProcedureStatusCommand.java:
##
@@ -59,10 +72,74 @@ public ShowResultSetMetaData getMetaData() {
 return builder.build();
 }
 
+private String extractFilterValue(PartitionColumnFilter colFilter) {
+
+InPredicate inPredicate = colFilter.getInPredicate();
+if (null == inPredicate) {
+// equal one value
+if (colFilter.lowerBoundInclusive && colFilter.upperBoundInclusive
+&& colFilter.lowerBound != null && colFilter.upperBound != 
null
+&& 0 == 
colFilter.lowerBound.compareLiteral(colFilter.upperBound)) {
+return colFilter.lowerBound.getStringValue();
+}
+}
+throw new AnalysisException("Only supports equalTo and Like in filter 
for whereClause");
+}
+
+private void validateAndExtractFilters(StringBuilder dbFilter, 
StringBuilder procFilter) throws Exception {
+Map filterMap = Maps.newHashMap();
+if (!this.whereExpr.isEmpty()) {
+
whereExpr.stream().map(ExpressionUtils::checkAndMaybeCommute).filter(Optional::isPresent)
+.forEach(expr -> new 
ExpressionColumnFilterConverter(filterMap).convert(expr.get()));
+}
+// we support filter on Db and Name and ProcedureName.
+// But one column we can put only once and support conjucts
+for (Map.Entry elem : 
filterMap.entrySet()) {
+String columnName = elem.getKey();
+if ((!columnName.equals("Db"))
+&& (!columnName.equals("Name"))
+&& (!columnName.equals("ProcedureName"))) {
+throw new AnalysisException("Only supports filter Db, Name, 
ProcedureName with equalTo or LIKE");
+}
+if (columnName.equals("Db")) {
+if (dbFilter.length() != 0) {
+throw new AnalysisException("Only supports filter Db only 
1 time in where clause");
+}
+dbFilter.append(extractFilterValue(elem.getValue()));
+} else if ((columnName.equals("Name"))
+|| (columnName.equals("ProcedureName"))) {
+if (procFilter.length() != 0) {
+throw new AnalysisException("Only supports filter 
Name/ProcedureName only 1 time in where clause");
+}
+procFilter.append(extractFilterValue(elem.getValue()));
+}
+}
+}
+
+private String extractLikeFilter() {
+String likeFilter = "";
+if (this.valueExpr == null) {
+return likeFilter;
+}
+Map filterMap = Maps.newHashMap();
+new ExpressionColumnFilterConverter(filterMap)
+.convert(this.valueExpr);
+for (Map.Entry elem : 
filterMap.entrySet()) {
+likeFilter = extractFilterValue(elem.getValue());

Review Comment:
   yes. i wiil use new class for expression converter.  will not change 
ExpressionColumnFilterConverter 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](compile) fix two compile errors on MacOS [doris]

2024-04-18 Thread via GitHub


morrySnow commented on PR #33834:
URL: https://github.com/apache/doris/pull/33834#issuecomment-2063191097

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](restore) Reset index id for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


w41ter opened a new pull request, #33835:
URL: https://github.com/apache/doris/pull/33835

   Cherry-pick #33831


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](java-udtf) support java-udtf [doris]

2024-04-18 Thread via GitHub


zhangstar333 commented on PR #33595:
URL: https://github.com/apache/doris/pull/33595#issuecomment-2063192522

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](restore) Reset index id for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33835:
URL: https://github.com/apache/doris/pull/33835#issuecomment-2063192469

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](restore) Reset index id for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


w41ter commented on PR #33835:
URL: https://github.com/apache/doris/pull/33835#issuecomment-2063192679

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](restore) Reset ids for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33831:
URL: https://github.com/apache/doris/pull/33831#issuecomment-2063193133

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](compile) fix two compile errors on MacOS [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33834:
URL: https://github.com/apache/doris/pull/33834#issuecomment-2063193369

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](compile) fix two compile errors on MacOS [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33834:
URL: https://github.com/apache/doris/pull/33834#issuecomment-2063193416

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [bugfix](paimon) Create paimon catalog with hadoop user [doris]

2024-04-18 Thread via GitHub


wuwenchi commented on PR #33833:
URL: https://github.com/apache/doris/pull/33833#issuecomment-2063193966

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](restore) Reset ids for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33831:
URL: https://github.com/apache/doris/pull/33831#issuecomment-2063193172

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](compile) fix two compile errors on MacOS [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33834:
URL: https://github.com/apache/doris/pull/33834#issuecomment-2063197696

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](Cloud) Enable write into file cache for hdfs writer [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33796:
URL: https://github.com/apache/doris/pull/33796#issuecomment-2063199520

   TeamCity be ut coverage result:
Function Coverage: 35.40% (8910/25168) 
Line Coverage: 27.10% (73196/270067)
Region Coverage: 26.23% (37817/144163)
Branch Coverage: 23.03% (19266/83640)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/3941adf0d8dcdcabfea18a7ee824bb339aef68bf_3941adf0d8dcdcabfea18a7ee824bb339aef68bf/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Refactor](executor)Add workload schedule policy table [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33729:
URL: https://github.com/apache/doris/pull/33729#issuecomment-2063206193

   TeamCity be ut coverage result:
Function Coverage: 35.43% (8913/25160) 
Line Coverage: 27.12% (73230/270038)
Region Coverage: 26.24% (37828/144143)
Branch Coverage: 23.05% (19278/83638)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/f235ebb575834401e2ca4648a8f1b734dc65e058_f235ebb575834401e2ca4648a8f1b734dc65e058/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](cloud)avoid transaction too large when dropping partition [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33700:
URL: https://github.com/apache/doris/pull/33700#issuecomment-2063216230

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](fe) Fix finalizeCommand `sendAndFlush` NullPointerException #33420 [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33828:
URL: https://github.com/apache/doris/pull/33828#issuecomment-2063216465

   
   
   TPC-H: Total hot run time: 49838 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit b53162e65de9ca0cb784761aa33fa73701551d00, 
data reload: false
   
   -- Round 1 --
   q1   17713   446543714371
   q2   2045147 140 140
   q3   10372   206718871887
   q4   10298   125213121252
   q5   8513395539923955
   q6   227 123 119 119
   q7   2010158815841584
   q8   9281273727382737
   q9   10865   10635   10396   10396
   q10  8636352735183518
   q11  429 239 238 238
   q12  462 296 307 296
   q13  18350   396740143967
   q14  345 320 327 320
   q15  511 461 459 459
   q16  715 590 590 590
   q17  1125962 973 962
   q18  7307675868486758
   q19  1722157815181518
   q20  514 319 296 296
   q21  4451409440924092
   q22  504 404 383 383
   Total cold run time: 116395 ms
   Total hot run time: 49838 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4341435043154315
   q2   322 225 220 220
   q3   4188414641634146
   q4   2766274627452745
   q5   7299719671917191
   q6   233 119 123 119
   q7   3213288028412841
   q8   4296443544564435
   q9   17144   16941   16978   16941
   q10  4260422842744228
   q11  750 676 690 676
   q12  1039848 875 848
   q13  6800370037633700
   q14  455 426 413 413
   q15  503 458 445 445
   q16  744 713 697 697
   q17  3791379037833783
   q18  8880878488618784
   q19  1723169616471647
   q20  2357211320932093
   q21  8478846984828469
   q22  1020953 961 953
   Total cold run time: 84602 ms
   Total hot run time: 79689 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](statistics)Improve analyze timeout logic. [doris]

2024-04-18 Thread via GitHub


Jibing-Li opened a new pull request, #33836:
URL: https://github.com/apache/doris/pull/33836

   Before, analyze_timeout will also affect analyze stmt, which may cause 
failed to cancel analyze task. This PR change analyze_timeout to only affect 
timeout value for executing analyze sql.
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](statistics)Improve analyze timeout logic. [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33836:
URL: https://github.com/apache/doris/pull/33836#issuecomment-2063217524

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](statistics)Improve analyze timeout logic. [doris]

2024-04-18 Thread via GitHub


Jibing-Li commented on PR #33836:
URL: https://github.com/apache/doris/pull/33836#issuecomment-2063218807

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](merge-cloud) Add `BrokerLoad` and `DriverUrl` white list [doris]

2024-04-18 Thread via GitHub


SWJTU-ZhangLei commented on PR #33003:
URL: https://github.com/apache/doris/pull/33003#issuecomment-2063220042

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch branch-2.0 updated: [chore](workflow) Increase the build space for building third-party libraries (#22322) (#33832)

2024-04-18 Thread morningman
This is an automated email from the ASF dual-hosted git repository.

morningman pushed a commit to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/branch-2.0 by this push:
 new 239d1b8193a [chore](workflow) Increase the build space for building 
third-party libraries (#22322) (#33832)
239d1b8193a is described below

commit 239d1b8193a6e98b3ad06797cdbcb12c90271f7a
Author: Adonis Ling 
AuthorDate: Thu Apr 18 15:38:30 2024 +0800

[chore](workflow) Increase the build space for building third-party 
libraries (#22322) (#33832)

Increase the build space for building third-party libraries
---
 .github/workflows/build-thirdparty.yml | 19 ++-
 1 file changed, 18 insertions(+), 1 deletion(-)

diff --git a/.github/workflows/build-thirdparty.yml 
b/.github/workflows/build-thirdparty.yml
index 510643a3a98..cf3837185cc 100644
--- a/.github/workflows/build-thirdparty.yml
+++ b/.github/workflows/build-thirdparty.yml
@@ -51,6 +51,21 @@ jobs:
 if: ${{ needs.changes.outputs.thirdparty_changes == 'true' }}
 runs-on: ubuntu-22.04
 steps:
+  - name: Checkout easimon/maximize-build-space
+run: |
+  git clone -b v7 https://github.com/easimon/maximize-build-space
+
+  - name: Maximize build space
+uses: ./maximize-build-space
+with:
+root-reserve-mb: 4096
+swap-size-mb: 8192
+remove-dotnet: 'true'
+remove-android: 'true'
+remove-haskell: 'true'
+remove-codeql: 'true'
+remove-docker-images: 'true'
+
   - name: Checkout ${{ github.ref }}
 uses: actions/checkout@v3
 
@@ -151,10 +166,12 @@ jobs:
 'llvm@16'
   )
 
-  brew install "${packages[@]}"
+  brew install "${packages[@]}" || true
 
   - name: Build
 run: |
+  export MACOSX_DEPLOYMENT_TARGET=12.0
+
   cd thirdparty
   ./build-thirdparty.sh -j "$(nproc)"
 


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [I] [Bug] doris自动分析问题 [doris]

2024-04-18 Thread via GitHub


Muzi999 commented on issue #27084:
URL: https://github.com/apache/doris/issues/27084#issuecomment-2063223609

   doris2.1.1 FE警告日志中一直在执行 这样的SQL
   SELECT SUBSTRING(CAST(MIN(`key`) AS STRING), 1, 1024) as min, 
   SUBSTRING(CAST(MAX(`key`) AS STRING), 1, 1024) as max 
   FROM `DB`.`Table`  index null
   然后每次执行都不成功 
   错误为
   Encountered: INDEX
   Expected: COMMA, INDEX is keyword, maybe `INDEX`
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [chore](workflow) Increase the build space for building third-party libraries (#22322) [doris]

2024-04-18 Thread via GitHub


morningman merged PR #33832:
URL: https://github.com/apache/doris/pull/33832


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [I] [Bug] doris自动分析问题 [doris]

2024-04-18 Thread via GitHub


Muzi999 commented on issue #27084:
URL: https://github.com/apache/doris/issues/27084#issuecomment-2063225451

   > #27321
   
   
   
   > #27321
   
   doris2.1.1 FE警告日志中一直在执行 这样的SQL
   SELECT SUBSTRING(CAST(MIN(key) AS STRING), 1, 1024) as min,
   SUBSTRING(CAST(MAX(key) AS STRING), 1, 1024) as max
   FROM DB.Table index null
   然后每次执行都不成功
   错误为
   Encountered: INDEX
   Expected: COMMA, INDEX is keyword, maybe INDEX
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [pipelineX](conf) Change pipeline tasks to pipelineX mode [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33791:
URL: https://github.com/apache/doris/pull/33791#issuecomment-2063232541

   TeamCity be ut coverage result:
Function Coverage: 35.43% (8912/25153) 
Line Coverage: 27.15% (73191/269555)
Region Coverage: 26.28% (37803/143866)
Branch Coverage: 23.09% (19262/83436)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/e5e62c99c4e4689071fd0f47d2ddbc744c0645b0_e5e62c99c4e4689071fd0f47d2ddbc744c0645b0/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](restore) Reset index id for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33835:
URL: https://github.com/apache/doris/pull/33835#issuecomment-2063232875

   
   
   TPC-H: Total hot run time: 49821 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit d8b7027af334c385872d67af6f305c08d455e3df, 
data reload: false
   
   -- Round 1 --
   q1   18150   436343444344
   q2   2020148 153 148
   q3   10445   187519701875
   q4   10267   124713301247
   q5   8513391339953913
   q6   226 121 122 121
   q7   2047160315781578
   q8   9302269926982698
   q9   11186   10819   10488   10488
   q10  8638352835183518
   q11  419 228 247 228
   q12  458 301 297 297
   q13  18347   398840463988
   q14  353 325 324 324
   q15  503 456 460 456
   q16  697 586 586 586
   q17  1124944 951 944
   q18  7316694867606760
   q19  1691159015561556
   q20  509 309 307 307
   q21  4371406040954060
   q22  492 406 385 385
   Total cold run time: 117074 ms
   Total hot run time: 49821 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4350429243054292
   q2   319 225 220 220
   q3   4188417541774175
   q4   2740275127652751
   q5   7268722172017201
   q6   232 122 115 115
   q7   3259280628482806
   q8   4297446944604460
   q9   17635   17298   17234   17234
   q10  4225420842154208
   q11  738 673 702 673
   q12  1020840 854 840
   q13  6466372437493724
   q14  451 427 420 420
   q15  499 461 448 448
   q16  753 689 709 689
   q17  3771382138433821
   q18  8767865188988651
   q19  1700168316231623
   q20  2408217421472147
   q21  8502854184468446
   q22  1010964 978 964
   Total cold run time: 84598 ms
   Total hot run time: 79908 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](Cloud) Enable write into file cache for hdfs writer [doris]

2024-04-18 Thread via GitHub


ByteYue commented on PR #33796:
URL: https://github.com/apache/doris/pull/33796#issuecomment-2063234012

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](Nereids): fix unstable plan shape in `limit_push_down` case [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33740:
URL: https://github.com/apache/doris/pull/33740#issuecomment-2063234210

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](decommission) fix cann't decommission mtmv [doris]

2024-04-18 Thread via GitHub


yujun777 commented on PR #33823:
URL: https://github.com/apache/doris/pull/33823#issuecomment-2063236966

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](fe) Fix finalizeCommand `sendAndFlush` NullPointerException #33420 [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33828:
URL: https://github.com/apache/doris/pull/33828#issuecomment-2063237629

   
   
   TPC-DS: Total hot run time: 205203 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit b53162e65de9ca0cb784761aa33fa73701551d00, 
data reload: false
   
   query1   921 392 384 384
   query2   6524280725942594
   query3   6917204 201 201
   query4   19889   17818   17826   17818
   query5   19718   650864426442
   query6   272 219 222 219
   query7   4153299 307 299
   query8   264 236 231 231
   query9   3201275026712671
   query10  406 287 293 287
   query11  11306   10693   10661   10661
   query12  119 71  66  66
   query13  5566676 688 676
   query14  17490   13073   13244   13073
   query15  360 242 230 230
   query16  6450267 255 255
   query17  17731454843 843
   query18  2353405 396 396
   query19  208 142 139 139
   query20  76  73  71  71
   query21  187 95  89  89
   query22  5309495050794950
   query23  32356   31952   31896   31896
   query24  6966646565086465
   query25  527 431 406 406
   query26  524 159 159 159
   query27  1786287 283 283
   query28  6251240623542354
   query29  2897271927072707
   query30  240 163 161 161
   query31  894 733 729 729
   query32  65  61  56  56
   query33  390 252 252 252
   query34  852 468 468 468
   query35  1115942 936 936
   query36  1586147211701170
   query37  90  63  55  55
   query38  3076291229232912
   query39  1351134613271327
   query40  201 89  94  89
   query41  35  37  32  32
   query42  83  76  81  76
   query43  764 634 785 634
   query44  1113724 714 714
   query45  237 226 224 224
   query46  1222957 964 957
   query47  1765197015881588
   query48  1020721 694 694
   query49  598 366 355 355
   query50  842 587 579 579
   query51  4800473846654665
   query52  88  73  84  73
   query53  440 316 311 311
   query54  2648247124682468
   query55  103 78  82  78
   query56  210 194 200 194
   query57  1229116310811081
   query58  207 192 196 192
   query59  4314401339593959
   query60  210 186 187 186
   query61  82  78  83  78
   query62  833 494 496 494
   query63  482 331 331 331
   query64  2315137214381372
   query65  3625350835243508
   query66  757 365 362 362
   query67  15380   18145   16575   16575
   query68  8917643 673 643
   query69  570 330 330 330
   query70  1537154214581458
   query71  417 293 307 293
   query72  6431343034083408
   query73  725 323 323 323
   query74  6278586957965796
   query75  5228362336603623
   query76  5579116611751166
   query77  946 261 245 245
   query78  12621   15213   13521   13521
   query79  10804   656 625 625
   query80  741 404 382 382
   query81  490 226 229 226
   query82  544 98  94  94
   query83  166 132 131 131
   query84  252 68  68  68
   query85  716 288 288 288
   query86  329 339 310 310
   query87  3303302329622962
   query88  5199232623152315
   query89  343 290 295 290
   query90  2682205 214 205
   query91  177 141 131 131
   query92  54  53  49  49
   query93  3530535 568 535
   query94  1187203 198 198
   query95  1091105010721050
   query96  639 332 323 323
   query97  6358636864216368
   query98  207 174 170 170
   query99  2677877 927 877
   Total cold run time: 310769 ms
   Total hot run time: 205203 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [fix](Nereids): fix unstable plan shape in `limit_push_down` case [doris]

2024-04-18 Thread via GitHub


starocean999 merged PR #33740:
URL: https://github.com/apache/doris/pull/33740


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated: [fix](Nereids)fix unstable plan shape in limit_push_down case

2024-04-18 Thread starocean999
This is an automated email from the ASF dual-hosted git repository.

starocean999 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new 31b3feb5eae [fix](Nereids)fix unstable plan shape in limit_push_down 
case
31b3feb5eae is described below

commit 31b3feb5eae1285be7fb541551a9b44ff4517050
Author: 谢健 
AuthorDate: Thu Apr 18 15:47:29 2024 +0800

[fix](Nereids)fix unstable plan shape in limit_push_down case
---
 .../org/apache/doris/nereids/cost/CostModelV1.java |  2 +-
 .../limit_push_down/limit_push_down.out| 89 +-
 .../limit_push_down/order_push_down.out| 86 +++--
 .../limit_push_down/limit_push_down.groovy |  8 +-
 .../limit_push_down/order_push_down.groovy | 48 ++--
 5 files changed, 111 insertions(+), 122 deletions(-)

diff --git 
a/fe/fe-core/src/main/java/org/apache/doris/nereids/cost/CostModelV1.java 
b/fe/fe-core/src/main/java/org/apache/doris/nereids/cost/CostModelV1.java
index d56a9d8be2a..d469dd3b40b 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/nereids/cost/CostModelV1.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/nereids/cost/CostModelV1.java
@@ -176,7 +176,7 @@ class CostModelV1 extends PlanVisitor {
 double rowCount = statistics.getRowCount();
 if (topN.getSortPhase().isGather()) {
 // Now we do more like two-phase sort, so penalise one-phase sort
-rowCount *= 100;
+rowCount = rowCount * 100 + 100;
 }
 return CostV1.of(context.getSessionVariable(), childRowCount, 
rowCount, childRowCount);
 }
diff --git 
a/regression-test/data/nereids_rules_p0/limit_push_down/limit_push_down.out 
b/regression-test/data/nereids_rules_p0/limit_push_down/limit_push_down.out
index cbf8a09c7e6..54b8a7a6b6c 100644
--- a/regression-test/data/nereids_rules_p0/limit_push_down/limit_push_down.out
+++ b/regression-test/data/nereids_rules_p0/limit_push_down/limit_push_down.out
@@ -274,60 +274,47 @@ PhysicalResultSink
 PhysicalResultSink
 --PhysicalLimit[GLOBAL]
 PhysicalLimit[LOCAL]
---hashAgg[GLOBAL]
-hashAgg[LOCAL]
---PhysicalUnion
-PhysicalLimit[LOCAL]
---hashAgg[LOCAL]
-filter((t1.id > 100))
---PhysicalOlapScan[t1]
-PhysicalLimit[LOCAL]
---hashAgg[LOCAL]
-filter((t2.id > 100))
---PhysicalOlapScan[t2]
+--PhysicalUnion
+PhysicalLimit[LOCAL]
+--filter((cast(msg as DOUBLE) > 100.0))
+PhysicalOlapScan[t1]
+PhysicalLimit[LOCAL]
+--filter((t2.id > 100))
+PhysicalOlapScan[t2]
 
 -- !limit_union_join --
 PhysicalResultSink
 --PhysicalLimit[GLOBAL]
 PhysicalLimit[LOCAL]
---hashAgg[GLOBAL]
-hashAgg[LOCAL]
---PhysicalUnion
+--PhysicalUnion
+PhysicalLimit[LOCAL]
+--hashJoin[RIGHT_OUTER_JOIN] hashCondition=((t1.id = t2.id)) 
otherCondition=()
+PhysicalOlapScan[t1]
 PhysicalLimit[LOCAL]
---hashAgg[GLOBAL]
-hashAgg[LOCAL]
---hashJoin[RIGHT_OUTER_JOIN] hashCondition=((t1.id = t2.id)) 
otherCondition=()
-PhysicalOlapScan[t1]
-PhysicalOlapScan[t2]
+--PhysicalOlapScan[t2]
+PhysicalLimit[LOCAL]
+--hashJoin[LEFT_OUTER_JOIN] hashCondition=((t3.id = t4.id)) 
otherCondition=()
 PhysicalLimit[LOCAL]
---hashAgg[LOCAL]
-hashJoin[LEFT_OUTER_JOIN] hashCondition=((t3.id = t4.id)) 
otherCondition=()
---PhysicalLimit[LOCAL]
-hashAgg[LOCAL]
---PhysicalOlapScan[t3]
---PhysicalOlapScan[t4]
+--PhysicalOlapScan[t3]
+PhysicalOlapScan[t4]
 
 -- !limit_union_window --
 PhysicalResultSink
 --PhysicalLimit[GLOBAL]
 PhysicalLimit[LOCAL]
---hashAgg[GLOBAL]
-hashAgg[LOCAL]
---PhysicalUnion
-PhysicalLimit[LOCAL]
---hashAgg[GLOBAL]
-hashAgg[LOCAL]
---PhysicalWindow
-PhysicalQuickSort[MERGE_SORT]
---PhysicalQuickSort[LOCAL_SORT]
-PhysicalOlapScan[t1]
-PhysicalLimit[LOCAL]
---hashAgg[GLOBAL]
-hashAgg[LOCAL]
---PhysicalWindow
-PhysicalQuickSort[MERGE_SORT]
---PhysicalQuickSort[LOCAL_SORT]
-PhysicalOlapScan[t2]
+--PhysicalUnion
+PhysicalLimit[LOCAL]
+--PhysicalWindow
+PhysicalQuickSort[MERGE_SORT]
+--PhysicalQuickSort[LOCAL_SORT]
+PhysicalPartitionTopN
+--PhysicalOlapScan[t1]
+PhysicalLimit[LOCAL]
+--PhysicalWindow
+-

Re: [PR] [func](jsonb)support json_depth function [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #24801:
URL: https://github.com/apache/doris/pull/24801#issuecomment-2063245364

   TeamCity be ut coverage result:
Function Coverage: 35.43% (8914/25162) 
Line Coverage: 27.12% (73231/270042)
Region Coverage: 26.25% (37831/144142)
Branch Coverage: 23.05% (19278/83650)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/2dd9ad0fa5991f6940de8fe8af20adc73ce2ec5f_2dd9ad0fa5991f6940de8fe8af20adc73ce2ec5f/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Improve](expr)first support array_contains for expr push down inverted index [doris]

2024-04-18 Thread via GitHub


amorynan commented on PR #32620:
URL: https://github.com/apache/doris/pull/32620#issuecomment-2063245913

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](Cloud) Enable write into file cache for hdfs writer [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on code in PR #33796:
URL: https://github.com/apache/doris/pull/33796#discussion_r1570190657


##
be/src/io/fs/hdfs_file_writer.cpp:
##
@@ -51,32 +75,154 @@ HdfsFileWriter::~HdfsFileWriter() {
 } else {
 delete _hdfs_handler;
 }
+hdfs_file_being_written << -1;
 }
 
 Status HdfsFileWriter::close() {
 if (_closed) {
 return Status::OK();
 }
 _closed = true;
-
+if (_batch_buffer.size() != 0) {
+RETURN_IF_ERROR(_flush_buffer());
+}
+int ret;
 if (_sync_file_data) {
-int ret = hdfsHSync(_hdfs_handler->hdfs_fs, _hdfs_file);
+{
+SCOPED_BVAR_LATENCY(hdfs_bvar::hdfs_hsync_latency);
+ret = hdfsHSync(_hdfs_handler->hdfs_fs, _hdfs_file);
+}
+
 if (ret != 0) {
 return Status::InternalError("failed to sync hdfs file. fs_name={} 
path={} : {}",
  _fs_name, _path.native(), 
hdfs_error());
 }
 }
 
-// The underlying implementation will invoke `hdfsHFlush` to flush 
buffered data and wait for
-// the HDFS response, but won't guarantee the synchronization of data to 
HDFS.
-int ret = hdfsCloseFile(_hdfs_handler->hdfs_fs, _hdfs_file);
+{
+SCOPED_BVAR_LATENCY(hdfs_bvar::hdfs_flush_latency);
+// The underlying implementation will invoke `hdfsHFlush` to flush 
buffered data and wait for
+// the HDFS response, but won't guarantee the synchronization of data 
to HDFS.
+ret = hdfsCloseFile(_hdfs_handler->hdfs_fs, _hdfs_file);
+}
 _hdfs_file = nullptr;
 if (ret != 0) {
 return Status::InternalError(
 "Write hdfs file failed. (BE: {}) namenode:{}, path:{}, err: 
{}",
 BackendOptions::get_localhost(), _fs_name, _path.native(), 
hdfs_error());
 }
+hdfs_file_created_total << 1;
+return Status::OK();
+}
+
+HdfsFileWriter::BatchBuffer::BatchBuffer(size_t capacity) {
+_batch_buffer.reserve(capacity);
+}
+
+bool HdfsFileWriter::BatchBuffer::full() const {
+return size() == capacity();
+}
+
+const char* HdfsFileWriter::BatchBuffer::data() const {
+return _batch_buffer.data();
+}
+
+size_t HdfsFileWriter::BatchBuffer::capacity() const {
+return _batch_buffer.capacity();
+}
+
+size_t HdfsFileWriter::BatchBuffer::size() const {
+return _batch_buffer.size();
+}
 
+void HdfsFileWriter::BatchBuffer::clear() {
+_batch_buffer.clear();
+}
+
+// TODO(ByteYue): Refactor Upload Buffer to reduce this duplicate code
+void HdfsFileWriter::_write_into_local_file_cache() {

Review Comment:
   warning: method '_write_into_local_file_cache' can be made static 
[readability-convert-member-functions-to-static]
   
   be/src/io/fs/hdfs_file_writer.h:57:
   ```diff
   - void _write_into_local_file_cache();
   + static void _write_into_local_file_cache();
   ```
   



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](fe) Fix finalizeCommand `sendAndFlush` NullPointerException #33420 [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33828:
URL: https://github.com/apache/doris/pull/33828#issuecomment-2063246730

   
   
   ClickBench: Total hot run time: 30.41 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit b53162e65de9ca0cb784761aa33fa73701551d00, 
data reload: false
   
   query1   0.030.020.02
   query2   0.070.020.02
   query3   0.250.040.05
   query4   1.810.070.06
   query5   0.530.520.52
   query6   1.240.620.61
   query7   0.010.010.01
   query8   0.040.030.02
   query9   0.530.490.48
   query10  0.550.530.54
   query11  0.130.080.08
   query12  0.110.090.09
   query13  0.620.610.61
   query14  0.780.770.79
   query15  0.780.760.76
   query16  0.390.370.36
   query17  1.031.011.01
   query18  0.240.260.24
   query19  1.901.831.86
   query20  0.020.010.01
   query21  15.46   0.560.55
   query22  2.172.031.51
   query23  17.47   1.020.91
   query24  5.511.230.84
   query25  0.310.120.05
   query26  0.680.160.15
   query27  0.050.040.04
   query28  7.500.750.69
   query29  12.71   2.342.30
   query30  0.630.580.54
   query31  2.820.390.38
   query32  3.390.500.49
   query33  3.053.063.13
   query34  15.26   4.804.76
   query35  4.874.834.84
   query36  1.091.001.01
   query37  0.060.040.04
   query38  0.040.020.02
   query39  0.010.020.01
   query40  0.160.140.14
   query41  0.070.020.01
   query42  0.020.020.01
   query43  0.030.020.01
   Total cold run time: 104.42 s
   Total hot run time: 30.41 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](fe) Fix finalizeCommand `sendAndFlush` NullPointerException #33420 [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33828:
URL: https://github.com/apache/doris/pull/33828#issuecomment-2063252245

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit b53162e65de9ca0cb784761aa33fa73701551d00 with 
default session variables
   Stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
   Stream load orc:  58 seconds loaded 1101869774 Bytes, about 18 MB/s
   Stream load parquet:  32 seconds loaded 861443392 Bytes, about 25 MB/s
   Insert into select:   19.9 seconds inserted 1000 Rows, about 502K 
ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [security] don't print initial_root_password [doris]

2024-04-18 Thread via GitHub


shoothzj commented on PR #33341:
URL: https://github.com/apache/doris/pull/33341#issuecomment-2063252192

   @wangbo @yiguolei Can this PR be merged? :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](restore) Reset index id for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33835:
URL: https://github.com/apache/doris/pull/33835#issuecomment-2063253802

   
   
   TPC-DS: Total hot run time: 202970 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit d8b7027af334c385872d67af6f305c08d455e3df, 
data reload: false
   
   query1   923 388 379 379
   query2   6518271625222522
   query3   6914204 202 202
   query4   20108   17987   17846   17846
   query5   19721   650265086502
   query6   295 220 226 220
   query7   4155303 301 301
   query8   256 266 225 225
   query9   3205275026772677
   query10  405 294 310 294
   query11  11263   10718   10660   10660
   query12  119 75  69  69
   query13  5569685 679 679
   query14  18221   13482   14060   13482
   query15  387 238 225 225
   query16  6457277 254 254
   query17  17691458875 875
   query18  2301407 396 396
   query19  204 152 144 144
   query20  75  74  76  74
   query21  183 91  92  91
   query22  5024507348534853
   query23  32725   31947   32013   31947
   query24  6907644964406440
   query25  540 439 430 430
   query26  518 163 156 156
   query27  1811301 290 290
   query28  6177239623912391
   query29  2940281427192719
   query30  243 160 162 160
   query31  901 710 734 710
   query32  70  59  58  58
   query33  396 247 251 247
   query34  840 459 471 459
   query35  1158918 967 918
   query36  1397127311241124
   query37  93  64  60  60
   query38  3112291528822882
   query39  1370132213271322
   query40  207 90  96  90
   query41  37  35  33  33
   query42  86  81  84  81
   query43  757 691 815 691
   query44  1129726 726 726
   query45  235 229 230 229
   query46  1253954 966 954
   query47  1872170817701708
   query48  1007737 705 705
   query49  607 363 366 363
   query50  864 610 577 577
   query51  4741461145694569
   query52  96  76  80  76
   query53  444 311 318 311
   query54  2635245724582457
   query55  95  71  78  71
   query56  227 220 204 204
   query57  1332118710321032
   query58  207 179 203 179
   query59  4102406341454063
   query60  223 212 222 212
   query61  89  86  88  86
   query62  857 473 547 473
   query63  470 331 328 328
   query64  2463148214101410
   query65  3637359035543554
   query66  774 366 370 366
   query67  15675   17503   15334   15334
   query68  8582658 648 648
   query69  589 355 360 355
   query70  1535141213841384
   query71  396 306 315 306
   query72  6448341634523416
   query73  746 324 327 324
   query74  6301588058425842
   query75  5046375337563753
   query76  5069114912431149
   query77  726 249 246 246
   query78  12803   11838   11783   11783
   query79  7177637 637 637
   query80  993 411 380 380
   query81  497 230 232 230
   query82  149997  99  97
   query83  165 137 131 131
   query84  260 68  72  68
   query85  854 300 296 296
   query86  327 296 292 292
   query87  3232293430142934
   query88  4924232923112311
   query89  362 293 306 293
   query90  1939212 213 212
   query91  167 131 142 131
   query92  61  51  49  49
   query93  4527580 563 563
   query94  732 198 205 198
   query95  1101107810771077
   query96  633 329 333 329
   query97  6551637464126374
   query98  200 176 169 169
   query99  2980939 828 828
   Total cold run time: 308813 ms
   Total hot run time: 202970 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t

Re: [PR] [Improve](expr)first support array_contains for expr push down inverted index [doris]

2024-04-18 Thread via GitHub


amorynan commented on PR #32620:
URL: https://github.com/apache/doris/pull/32620#issuecomment-2063255354

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [refactor](filesystem)refactor `filesystem` interface [doris]

2024-04-18 Thread via GitHub


morningman merged PR #33361:
URL: https://github.com/apache/doris/pull/33361


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated (31b3feb5eae -> f9e9c36bcb4)

2024-04-18 Thread morningman
This is an automated email from the ASF dual-hosted git repository.

morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 31b3feb5eae [fix](Nereids)fix unstable plan shape in limit_push_down 
case
 add f9e9c36bcb4 [refactor](filesystem)refactor `filesystem` interface 
(#33361)

No new revisions were added by this update.

Summary of changes:
 .../java/org/apache/doris/backup/Repository.java   |   8 +-
 .../org/apache/doris/common/util/BrokerUtil.java   |   2 +-
 .../doris/datasource/hive/HMSTransaction.java  |  36 ---
 .../doris/datasource/hive/HiveMetaStoreCache.java  |  71 +++--
 .../main/java/org/apache/doris/fs/FileSystem.java  |  61 +--
 .../java/org/apache/doris/fs/FileSystemUtil.java   |  70 +
 .../org/apache/doris/fs/LocalDfsFileSystem.java|  81 +++
 .../apache/doris/fs/remote/BrokerFileSystem.java   |  20 ++--
 .../apache/doris/fs/remote/RemoteFileSystem.java   |  76 ++
 .../org/apache/doris/fs/remote/S3FileSystem.java   |   2 +-
 .../apache/doris/fs/remote/dfs/DFSFileSystem.java  | 114 +
 .../org/apache/doris/backup/BrokerStorageTest.java |   2 +-
 .../org/apache/doris/backup/RepositoryTest.java|   8 +-
 .../org/apache/doris/fs/obj/S3FileSystemTest.java  |   4 +-
 14 files changed, 253 insertions(+), 302 deletions(-)
 create mode 100644 
fe/fe-core/src/main/java/org/apache/doris/fs/FileSystemUtil.java


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [improve](load) limit flush thread num proportional to CPU count [doris]

2024-04-18 Thread via GitHub


liaoxin01 commented on code in PR #33325:
URL: https://github.com/apache/doris/pull/33325#discussion_r1570194029


##
be/src/olap/memtable_flush_executor.cpp:
##
@@ -203,15 +203,18 @@ void 
FlushToken::_flush_memtable(std::unique_ptr memtable_ptr, int32_t
 
 void MemTableFlushExecutor::init(int num_disk) {
 num_disk = std::max(1, num_disk);
-size_t min_threads = std::max(1, config::flush_thread_num_per_store);
-size_t max_threads = num_disk * min_threads;
+int num_cpus = static_cast(std::thread::hardware_concurrency());

Review Comment:
If the value is not well defined or not computable,hardware_concurrency may 
return 0. We should process this case.



##
be/src/common/config.cpp:
##
@@ -662,6 +662,12 @@ DEFINE_mInt64(storage_flood_stage_left_capacity_bytes, 
"1073741824"); // 1GB
 DEFINE_Int32(flush_thread_num_per_store, "6");
 // number of thread for flushing memtable per store, for high priority load 
task
 DEFINE_Int32(high_priority_flush_thread_num_per_store, "6");
+// number of threads = min(flush_thread_num_per_store * num_store,
+// max_flush_thread_num_per_cpu * num_cpu)
+DEFINE_Int32(max_flush_thread_num_per_cpu, "8");

Review Comment:
   The default value of 8 is a bit large, and 2 or 4 may be more suitable.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](restore) Reset index id for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33835:
URL: https://github.com/apache/doris/pull/33835#issuecomment-2063264163

   
   
   ClickBench: Total hot run time: 30.39 s
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit d8b7027af334c385872d67af6f305c08d455e3df, 
data reload: false
   
   query1   0.030.020.02
   query2   0.070.020.02
   query3   0.240.050.05
   query4   1.810.070.07
   query5   0.530.530.52
   query6   1.240.610.62
   query7   0.010.010.01
   query8   0.030.020.02
   query9   0.510.490.48
   query10  0.540.540.54
   query11  0.120.090.09
   query12  0.120.090.09
   query13  0.610.610.61
   query14  0.760.790.79
   query15  0.780.770.77
   query16  0.360.370.37
   query17  1.010.971.05
   query18  0.260.250.22
   query19  1.931.871.88
   query20  0.020.010.01
   query21  15.47   0.550.56
   query22  2.021.931.54
   query23  17.07   1.041.02
   query24  6.090.691.06
   query25  0.370.120.03
   query26  0.580.160.15
   query27  0.040.040.03
   query28  7.430.710.72
   query29  12.63   2.152.33
   query30  0.560.520.52
   query31  2.800.390.37
   query32  3.390.500.49
   query33  3.073.063.06
   query34  15.26   4.804.84
   query35  4.894.894.87
   query36  1.071.011.01
   query37  0.060.050.05
   query38  0.040.020.02
   query39  0.020.010.02
   query40  0.160.140.15
   query41  0.070.020.02
   query42  0.020.020.02
   query43  0.020.010.02
   Total cold run time: 104.11 s
   Total hot run time: 30.39 s
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](restore) Reset index id for MaterializedIndexMeta [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33835:
URL: https://github.com/apache/doris/pull/33835#issuecomment-2063269733

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit d8b7027af334c385872d67af6f305c08d455e3df with 
default session variables
   Stream load json: 21 seconds loaded 2358488459 Bytes, about 107 MB/s
   Stream load orc:  59 seconds loaded 1101869774 Bytes, about 17 MB/s
   Stream load parquet:  32 seconds loaded 861443392 Bytes, about 25 MB/s
   Insert into select:   20.0 seconds inserted 1000 Rows, about 500K 
ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhencement](Nereids) string compare with empty string convert to length greater than zero [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33837:
URL: https://github.com/apache/doris/pull/33837#issuecomment-2063291391

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Enhencement](Nereids) string compare with empty string convert to length greater than zero [doris]

2024-04-18 Thread via GitHub


LiBinfeng-01 commented on PR #33837:
URL: https://github.com/apache/doris/pull/33837#issuecomment-2063291720

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [minor](Nereids): remove useless getFilterConjuncts() filter() in Translator [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33801:
URL: https://github.com/apache/doris/pull/33801#issuecomment-2063295105

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [enhancement](profile) get real-time query profile [doris]

2024-04-18 Thread via GitHub


zhiqiang- commented on PR #33383:
URL: https://github.com/apache/doris/pull/33383#issuecomment-2063298633

   run feut


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](merge-cloud) Add `BrokerLoad` and `DriverUrl` white list [doris]

2024-04-18 Thread via GitHub


SWJTU-ZhangLei commented on PR #33003:
URL: https://github.com/apache/doris/pull/33003#issuecomment-2063299502

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](memory) Test query memory leak [doris]

2024-04-18 Thread via GitHub


xinyiZzz closed pull request #33175: [test](memory) Test query memory leak
URL: https://github.com/apache/doris/pull/33175


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](merge-cloud) Add `BrokerLoad` and `DriverUrl` white list [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33003:
URL: https://github.com/apache/doris/pull/33003#issuecomment-2063316829

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](merge-cloud) Add `BrokerLoad` and `DriverUrl` white list [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33003:
URL: https://github.com/apache/doris/pull/33003#issuecomment-2063316916

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](memory) Fix ExecEnv destroy memory tracking [doris]

2024-04-18 Thread via GitHub


xinyiZzz commented on PR #33781:
URL: https://github.com/apache/doris/pull/33781#issuecomment-2063318176

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [Doc](jdbc) Modify `jdbc_driver_secure_path` desc when set is empty [doris-website]

2024-04-18 Thread via GitHub


SWJTU-ZhangLei opened a new pull request, #571:
URL: https://github.com/apache/doris-website/pull/571

   (no comment)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [minor](Nereids): remove useless getFilterConjuncts() filter() in Translator [doris]

2024-04-18 Thread via GitHub


jackwener merged PR #33801:
URL: https://github.com/apache/doris/pull/33801


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch master updated (f9e9c36bcb4 -> a16d11ea610)

2024-04-18 Thread jakevin
This is an automated email from the ASF dual-hosted git repository.

jakevin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from f9e9c36bcb4 [refactor](filesystem)refactor `filesystem` interface 
(#33361)
 add a16d11ea610 [minor](Nereids): remove useless getFilterConjuncts() 
filter() in Translator (#33801)

No new revisions were added by this update.

Summary of changes:
 .../glue/translator/PhysicalPlanTranslator.java| 317 ++---
 .../java/org/apache/doris/nereids/memo/Memo.java   |  10 -
 .../nereids/rules/rewrite/EliminateFilterTest.java |  42 ++-
 3 files changed, 191 insertions(+), 178 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](memory) Fix ExecEnv destroy memory tracking [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33781:
URL: https://github.com/apache/doris/pull/33781#issuecomment-2063327870

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Feature](top-n) support topn filter on vscan node [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33496:
URL: https://github.com/apache/doris/pull/33496#issuecomment-2063329292

   TeamCity be ut coverage result:
Function Coverage: 35.40% (8912/25172) 
Line Coverage: 27.12% (73229/270033)
Region Coverage: 26.25% (37829/144119)
Branch Coverage: 23.06% (19282/83600)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/4e56e96c2cc4c9ae35966758a3853a007fbe4dbc_4e56e96c2cc4c9ae35966758a3853a007fbe4dbc/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [WIP]Profile persist [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33690:
URL: https://github.com/apache/doris/pull/33690#issuecomment-2063331558

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](nereids) fix qualifier problem that affects delete stmt in another catalog #32853 [doris]

2024-04-18 Thread via GitHub


xiaokang commented on PR #33768:
URL: https://github.com/apache/doris/pull/33768#issuecomment-2063335155

   run buildall 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [pick](Nereids) cherry-pick prs to branch-2.0 [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33838:
URL: https://github.com/apache/doris/pull/33838#issuecomment-2063336093

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [fix](fe) Fix finalizeCommand `sendAndFlush` NullPointerException #33420 [doris]

2024-04-18 Thread via GitHub


xiaokang merged PR #33828:
URL: https://github.com/apache/doris/pull/33828


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



(doris) branch branch-2.0 updated (239d1b8193a -> e23e12e0423)

2024-04-18 Thread kxiao
This is an automated email from the ASF dual-hosted git repository.

kxiao pushed a change to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git


from 239d1b8193a [chore](workflow) Increase the build space for building 
third-party libraries (#22322) (#33832)
 add e23e12e0423 [fix](fe) Fix finalizeCommand `sendAndFlush` 
NullPointerException #33420 (#33828)

No new revisions were added by this update.

Summary of changes:
 .../src/main/java/org/apache/doris/qe/ConnectProcessor.java   | 11 +--
 1 file changed, 5 insertions(+), 6 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](Cloud) Enable write into file cache for hdfs writer [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33796:
URL: https://github.com/apache/doris/pull/33796#issuecomment-2063340535

   TeamCity be ut coverage result:
Function Coverage: 35.40% (8911/25170) 
Line Coverage: 27.11% (73207/270068)
Region Coverage: 26.24% (37825/144165)
Branch Coverage: 23.04% (19269/83644)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/01db2b0d605a3e731c9359820065b81bb4d3654c_01db2b0d605a3e731c9359820065b81bb4d3654c/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [opt](plugin) improve logstash doris output plugin [doris]

2024-04-18 Thread via GitHub


xiaokang commented on PR #33135:
URL: https://github.com/apache/doris/pull/33135#issuecomment-2063353306

   run cloud_p1


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [bugfix](hive)delete write path after hive insert [doris]

2024-04-18 Thread via GitHub


wuwenchi commented on PR #33798:
URL: https://github.com/apache/doris/pull/33798#issuecomment-2063354376

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Improvement](executor)Refactor Workload group memory GC [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33797:
URL: https://github.com/apache/doris/pull/33797#issuecomment-2063355980

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature](java-udtf) support java-udtf [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33595:
URL: https://github.com/apache/doris/pull/33595#issuecomment-2063355770

   TeamCity be ut coverage result:
Function Coverage: 35.41% (8913/25170) 
Line Coverage: 27.11% (73241/270147)
Region Coverage: 26.25% (37844/144190)
Branch Coverage: 23.05% (19283/83650)
Coverage Report: 
http://coverage.selectdb-in.cc/coverage/8a58d458739f04f81e57136f497ff403755ff2b9_8a58d458739f04f81e57136f497ff403755ff2b9/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Improvement](executor)Refactor Workload group memory GC [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33797:
URL: https://github.com/apache/doris/pull/33797#issuecomment-2063355906

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [doc](fix)delete the description of array_agg on 2.0 [doris-website]

2024-04-18 Thread via GitHub


echo-hhj opened a new pull request, #572:
URL: https://github.com/apache/doris-website/pull/572

   The array_agg function is only available in 2.1


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Improvement](executor)Refactor Workload group memory GC [doris]

2024-04-18 Thread via GitHub


xinyiZzz commented on code in PR #33797:
URL: https://github.com/apache/doris/pull/33797#discussion_r1570294754


##
be/src/runtime/workload_group/workload_group.cpp:
##
@@ -142,18 +142,42 @@ void 
WorkloadGroup::remove_mem_tracker_limiter(std::shared_ptr

Re: [PR] [Improvement](executor)Refactor Workload group memory GC [doris]

2024-04-18 Thread via GitHub


xinyiZzz commented on code in PR #33797:
URL: https://github.com/apache/doris/pull/33797#discussion_r1570296779


##
be/src/util/mem_info.h:
##
@@ -195,7 +195,7 @@ class MemInfo {
 
 static int64_t tg_not_enable_overcommit_group_gc();
 static int64_t tg_enable_overcommit_group_gc(int64_t request_free_memory,
- RuntimeProfile* profile);
+ RuntimeProfile* profile, bool 
is_minor_gc);

Review Comment:
   only_cancel_overcommit maybe sound better, of course that is ok



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [feature-wip](Cloud) Show isDefault vault in show storage vault stmt [doris]

2024-04-18 Thread via GitHub


ByteYue opened a new pull request, #33839:
URL: https://github.com/apache/doris/pull/33839

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature-wip](Cloud) Show isDefault vault in show storage vault stmt [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33839:
URL: https://github.com/apache/doris/pull/33839#issuecomment-2063365234

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Refactor](executor)Add workload schedule policy table [doris]

2024-04-18 Thread via GitHub


wangbo commented on PR #33729:
URL: https://github.com/apache/doris/pull/33729#issuecomment-2063370802

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [Fix](nereids) fix qualifier problem that affects delete stmt in another catalog #32853 [doris]

2024-04-18 Thread via GitHub


doris-robot commented on PR #33768:
URL: https://github.com/apache/doris/pull/33768#issuecomment-2063374003

   
   
   TPC-H: Total hot run time: 49715 ms
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 1876e3e1c271909d08dace508082a5dec78ed6c5, 
data reload: false
   
   -- Round 1 --
   q1   17648   443343064306
   q2   2026155 141 141
   q3   10533   193019291929
   q4   10321   126013191260
   q5   8419393439603934
   q6   233 123 126 123
   q7   2031157915521552
   q8   9236270926932693
   q9   10797   10429   10483   10429
   q10  8634351035243510
   q11  411 245 248 245
   q12  458 297 304 297
   q13  18338   396540303965
   q14  356 314 322 314
   q15  508 460 460 460
   q16  692 597 586 586
   q17  1128947 966 947
   q18  7329674368026743
   q19  1681155215831552
   q20  538 301 304 301
   q21  4380406240484048
   q22  500 380 396 380
   Total cold run time: 116197 ms
   Total hot run time: 49715 ms
   
   - Round 2, with runtime_filter_mode=off -
   q1   4315427342664266
   q2   317 218 229 218
   q3   4155414741014101
   q4   2753272927362729
   q5   7225711171197111
   q6   232 125 119 119
   q7   3170278828042788
   q8   4327444344114411
   q9   16993   16841   16873   16841
   q10  4229425642774256
   q11  751 685 680 680
   q12  1047852 854 852
   q13  5666377937563756
   q14  442 425 419 419
   q15  502 462 461 461
   q16  753 700 689 689
   q17  3730375737573757
   q18  8719869688668696
   q19  1694170216821682
   q20  2417212221032103
   q21  8527838384428383
   q22  1033971 935 935
   Total cold run time: 82997 ms
   Total hot run time: 79253 ms
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature-wip](Cloud) Show isDefault vault in show storage vault stmt [doris]

2024-04-18 Thread via GitHub


ByteYue commented on PR #33839:
URL: https://github.com/apache/doris/pull/33839#issuecomment-2063374970

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [feature-wip](Cloud) Show isDefault vault in show storage vault stmt [doris]

2024-04-18 Thread via GitHub


github-actions[bot] commented on PR #33839:
URL: https://github.com/apache/doris/pull/33839#issuecomment-2063377091

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [fix](nereids)BE cannot find min-max runtime filter on nested loop join node branch-2.0 [doris]

2024-04-18 Thread via GitHub


englefly opened a new pull request, #33840:
URL: https://github.com/apache/doris/pull/33840

   ## Proposed changes
   pick #32886
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



  1   2   3   4   5   6   7   >