[GitHub] [doris] xy720 commented on pull request #18404: [bug](array) fix be core in array_with_constant function when the first argument is nullable
xy720 commented on PR #18404: URL: https://github.com/apache/doris/pull/18404#issuecomment-1502781030 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] LookSin commented on issue #17341: [Enhancement] move mv regression-test case from fe ut MaterializedViewFunctionTest
LookSin commented on issue #17341: URL: https://github.com/apache/doris/issues/17341#issuecomment-1502782316 Hi, I want to try testAggQueryOnAggMV4,testAggQueryOnAggMV8 and testAggQueryOnAggMV9.Can I do this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] 924060929 opened a new pull request, #18548: [fix](Nerieds) Fix some bug
924060929 opened a new pull request, #18548: URL: https://github.com/apache/doris/pull/18548 # Proposed changes 1. fix bind ambiguous slots exception because select same slots 2. fix bind SetOperation multiple times because CTE 3. fix case when clause not corecion to same type ## Checklist(Required) * [ ] Does it affect the original behavior * [x] Has unit tests been added * [ ] Has document been added or modified * [ ] Does it need to update dependencies * [x] Is this PR support rollback (If NO, please explain WHY) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] TangSiyang2001 commented on pull request #18421: [enhancement-wip](load) merge single-replica related services as non-standalone
TangSiyang2001 commented on PR #18421: URL: https://github.com/apache/doris/pull/18421#issuecomment-1502784813 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] LemonLiTree commented on pull request #18526: [feature](GEO)Support read/write WKB/EWKB to gis types
LemonLiTree commented on PR #18526: URL: https://github.com/apache/doris/pull/18526#issuecomment-1502785291 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18404: [bug](array) fix be core in array_with_constant function when the first argument is nullable
github-actions[bot] commented on PR #18404: URL: https://github.com/apache/doris/pull/18404#issuecomment-1502787517 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18526: [feature](GEO)Support read/write WKB/EWKB to gis types
github-actions[bot] commented on PR #18526: URL: https://github.com/apache/doris/pull/18526#issuecomment-1502788956 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt commented on issue #17341: [Enhancement] move mv regression-test case from fe ut MaterializedViewFunctionTest
BiteThet commented on issue #17341: URL: https://github.com/apache/doris/issues/17341#issuecomment-1502789136 > Hi, I want to try testAggQueryOnAggMV4,testAggQueryOnAggMV8 and testAggQueryOnAggMV9.Can I do this? welcome. If you encounter any problems, you can raise them in issue. You can find the corresponding sql in the unit test of fe according to the name of the case, and then add it to the regression-test according to the format (refer to other pr). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] LookSin commented on issue #17341: [Enhancement] move mv regression-test case from fe ut MaterializedViewFunctionTest
LookSin commented on issue #17341: URL: https://github.com/apache/doris/issues/17341#issuecomment-1502790421 Hi,I can add move mv regression-test case for testAggQueryOnAggMV4, testAggQueryOnAggMV8 and testAggQueryOnAggMV9.Can I have a try? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] morningman commented on pull request #18542: [Doc] (Show) add doc for show create repository statement
morningman commented on PR #18542: URL: https://github.com/apache/doris/pull/18542#issuecomment-1502791023 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] kaka11chen commented on pull request #18531: [chore](orc) Update orc lib to third party lib(1.8.3) using git submodule.
kaka11chen commented on PR #18531: URL: https://github.com/apache/doris/pull/18531#issuecomment-1502791132 build all -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18421: [enhancement-wip](load) merge single-replica related services as non-standalone
github-actions[bot] commented on PR #18421: URL: https://github.com/apache/doris/pull/18421#issuecomment-1502791537 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] LookSin commented on issue #17341: [Enhancement] move mv regression-test case from fe ut MaterializedViewFunctionTest
LookSin commented on issue #17341: URL: https://github.com/apache/doris/issues/17341#issuecomment-1502791631 > Ok, I get it！ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Mryange commented on pull request #18486: [feature](function) Add new parameters to 'trim'.
Mryange commented on PR #18486: URL: https://github.com/apache/doris/pull/18486#issuecomment-1502792696 run clickbench -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yongjinhou commented on pull request #18519: [feature-wip](resource-group) Support resource group tvf
yongjinhou commented on PR #18519: URL: https://github.com/apache/doris/pull/18519#issuecomment-1502793136 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18519: [feature-wip](resource-group) Support resource group tvf
github-actions[bot] commented on PR #18519: URL: https://github.com/apache/doris/pull/18519#issuecomment-1502795740 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yongjinhou commented on pull request #18519: [feature-wip](resource-group) Support resource group tvf
yongjinhou commented on PR #18519: URL: https://github.com/apache/doris/pull/18519#issuecomment-1502799375 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Gabriel39 opened a new pull request, #18549: [Bug](decimal) fix wrong key ranges
Gabriel39 opened a new pull request, #18549: URL: https://github.com/apache/doris/pull/18549 # Proposed changes  ## Problem summary Describe your changes. ## Checklist(Required) * [ ] Does it affect the original behavior * [ ] Has unit tests been added * [ ] Has document been added or modified * [ ] Does it need to update dependencies * [ ] Is this PR support rollback (If NO, please explain WHY) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] xy720 commented on pull request #18519: [feature-wip](resource-group) Support resource group tvf
xy720 commented on PR #18519: URL: https://github.com/apache/doris/pull/18519#issuecomment-1502801664 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] morrySnow merged pull request #18502: [ehancement](stats) Stats preheating as FE booted
morrySnow merged PR #18502: URL: https://github.com/apache/doris/pull/18502 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [ehancement](stats) Stats preheating as FE booted (#18502)
This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 1b70db54df [ehancement](stats) Stats preheating as FE booted (#18502)
1b70db54df is described below
commit 1b70db54dfd4b372392cf294894c2f830f6f96dd
Author: AKIRA <33112463+kikyou1...@users.noreply.github.com>
AuthorDate: Tue Apr 11 16:19:59 2023 +0900
[ehancement](stats) Stats preheating as FE booted (#18502)
1. Support prefetch some column stats when FE booted, it would load column
stats that was got updated recently according to the comment of PR #18460 from
@morrySnow
2. Refactor stats cache, split histogram cache from column stats, so that
we could avoid some redundant query for column statistics table,for example,
update the histogram or column stats only, in the previous implementation a
united cache loader would send query request to both column stats table and
histogram table,
3. Extract some common logic to StatsUtil
4. Remove some useless codes in unit tests, those codes is hard to
maintaince and it's not a good idea for testing the accurracy of stats
estimation according to the advise from @englefly
5. Add field type restriction when create analysis tasks to avoid
unnecessary failure
---
.../main/java/org/apache/doris/catalog/Env.java|3 +
.../doris/nereids/stats/StatsCalculator.java | 24 +-
.../apache/doris/statistics/AnalysisManager.java |4 +-
.../doris/statistics/AnalysisTaskScheduler.java| 58 +-
.../apache/doris/statistics/BaseAnalysisTask.java | 33 +-
.../statistics/ColumnLevelStatisticCache.java | 52 -
.../apache/doris/statistics/ColumnStatistic.java |4 +-
.../statistics/ColumnStatisticsCacheLoader.java| 66 +
.../doris/statistics/HistogramCacheLoader.java | 65 +
.../org/apache/doris/statistics/HistogramTask.java |2 +-
.../apache/doris/statistics/HiveAnalysisTask.java |2 +-
.../apache/doris/statistics/MVAnalysisTask.java|2 +-
.../apache/doris/statistics/OlapAnalysisTask.java |2 +-
.../doris/statistics/StatisticConstants.java |5 +-
.../apache/doris/statistics/StatisticsCache.java | 141 +-
.../doris/statistics/StatisticsCacheKey.java | 12 +
.../doris/statistics/StatisticsCacheLoader.java| 112 +-
.../doris/statistics/StatisticsRepository.java | 25 +-
.../doris/statistics/util/StatisticsUtil.java | 17 +
.../nereids/jobs/cascades/DeriveStatsJobTest.java |3 -
.../org/apache/doris/nereids/stats/TPCHStats.java | 2094
.../org/apache/doris/nereids/stats/TestStats.java | 151 --
.../org/apache/doris/statistics/CacheTest.java | 52 +-
23 files changed, 451 insertions(+), 2478 deletions(-)
diff --git a/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
b/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
index 9ac1027efc..5bdf74f1fe 100755
--- a/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/catalog/Env.java
@@ -1345,6 +1345,9 @@ public class Env {
LOG.info(msg);
// for master, there are some new thread pools need to register metric
ThreadPoolManager.registerAllThreadPoolMetric();
+if (analysisManager != null) {
+analysisManager.getStatisticsCache().preHeat();
+}
}
/*
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/nereids/stats/StatsCalculator.java
b/fe/fe-core/src/main/java/org/apache/doris/nereids/stats/StatsCalculator.java
index 942c19a6ac..75b637890d 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/nereids/stats/StatsCalculator.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/nereids/stats/StatsCalculator.java
@@ -90,9 +90,9 @@ import
org.apache.doris.nereids.trees.plans.physical.PhysicalUnion;
import org.apache.doris.nereids.trees.plans.physical.PhysicalWindow;
import org.apache.doris.nereids.trees.plans.visitor.DefaultPlanVisitor;
import org.apache.doris.nereids.types.DataType;
-import org.apache.doris.statistics.ColumnLevelStatisticCache;
import org.apache.doris.statistics.ColumnStatistic;
import org.apache.doris.statistics.ColumnStatisticBuilder;
+import org.apache.doris.statistics.Histogram;
import org.apache.doris.statistics.StatisticRange;
import org.apache.doris.statistics.Statistics;
import org.apache.doris.statistics.StatisticsBuilder;
@@ -177,7 +177,6 @@ public class StatsCalculator extends
DefaultPlanVisitor {
@Override
public Statistics visitLogicalOlapScan(LogicalOlapScan olapScan, Void
context) {
-olapScan.getExpressions();
return computeScan(olapScan);
}
@@ -431,17 +430,22 @@ public class StatsCalculator extends
DefaultPlanVisitor {
for (SlotReference slotReference : slotSet) {
String colName =
[GitHub] [doris] github-actions[bot] commented on pull request #18519: [feature-wip](resource-group) Support resource group tvf
github-actions[bot] commented on PR #18519: URL: https://github.com/apache/doris/pull/18519#issuecomment-1502803638 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] xy720 commented on pull request #18392: [feature](function) support any type in SQL function
xy720 commented on PR #18392: URL: https://github.com/apache/doris/pull/18392#issuecomment-1502807053 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris-thirdparty] adonis0147 opened a new pull request, #53: [chore] Porting to GCC 12.2
adonis0147 opened a new pull request, #53: URL: https://github.com/apache/doris-thirdparty/pull/53 Currently, some errors occur when building clucene by GCC-12.2. This PR fixes these errors. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dutyu opened a new issue, #18550: [Bug] query returns a wrong result when kerberos token is expired
dutyu opened a new issue, #18550: URL: https://github.com/apache/doris/issues/18550 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version 1.2.2-rc01 ### What's Wrong? When querying from a hive catalog with kerberos enabled, if the kerberos token is expired, query will always return a wrong result set (always 0 rows returned but it should not be).  In fact this table has 25 rows. ### What You Expected? Query from a hive catalog should return a right result even the kerberos token is expired. ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] dutyu opened a new pull request, #18551: [Fix](multi-catalog) fix hive catalog query bug when kerberos token i…
dutyu opened a new pull request, #18551: URL: https://github.com/apache/doris/pull/18551 …s expired. # Proposed changes Issue Number: close #18550 ## Problem summary Describe your changes. ## Checklist(Required) * [ ] Does it affect the original behavior * [ ] Has unit tests been added * [ ] Has document been added or modified * [ ] Does it need to update dependencies * [ ] Is this PR support rollback (If NO, please explain WHY) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] freemandealer commented on a diff in pull request #18528: [WIP][fix](storage) free dict_page immediately after usage to save memory
freemandealer commented on code in PR #18528: URL: https://github.com/apache/doris/pull/18528#discussion_r1162427202 ## be/src/olap/rowset/segment_v2/column_reader.cpp: ## @@ -1107,9 +1107,10 @@ Status FileColumnIterator::_read_data_page(const OrdinalPageIndexIterator& iter) Slice dict_data; PageFooterPB dict_footer; _opts.type = INDEX_PAGE; Review Comment: > If index is used, is there such case that we read page number 10 first and then read page number 1? Or in other words, could we make sure that the data page is read in descending order? @yiguolei Yes, we are sure the data page is read in ascending order: after locating the first target page, we will read the following pages sequentially, for a single query of course. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yiguolei merged pull request #18496: [optimize](string) optimize split_by_string and substring_index function
yiguolei merged PR #18496: URL: https://github.com/apache/doris/pull/18496 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [optimize](string) optimize split_by_string and substring_index function (#18496)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 0c5e3df4a3 [optimize](string) optimize split_by_string and
substring_index function (#18496)
0c5e3df4a3 is described below
commit 0c5e3df4a37c4822bfa929e3146c7629d14b8b75
Author: ZhangYu0123 <67053339+zhangyu0...@users.noreply.github.com>
AuthorDate: Tue Apr 11 15:49:03 2023 +0800
[optimize](string) optimize split_by_string and substring_index function
(#18496)
Use SIMD stringsearcher and SIMD memcmp optimze split_by_string and
substring_index function.
split_by_string function has 32%~540% up
substring_index function has 22%~46% up
Performance difference depends on the needle size and whether the needle is
constant param. And the longer the needle, the more performance improvement
---
be/src/vec/functions/function_string.h | 123 +++--
1 file changed, 100 insertions(+), 23 deletions(-)
diff --git a/be/src/vec/functions/function_string.h
b/be/src/vec/functions/function_string.h
index 83b6782192..713d8864d3 100644
--- a/be/src/vec/functions/function_string.h
+++ b/be/src/vec/functions/function_string.h
@@ -1569,17 +1569,17 @@ public:
}
}
} else {
-// If delimiter is a string, use memmem to split
+StringRef delimiter_ref(delimiter);
+StringSearch search(&delimiter_ref);
for (size_t i = 0; i < input_rows_count; ++i) {
auto str = str_col->get_data_at(i);
int32_t offset = -delimiter_size;
int32_t num = 0;
while (num < part_number) {
size_t n = str.size - offset - delimiter_size;
-char* pos = reinterpret_cast(
-memmem(str.data + offset + delimiter_size, n,
delimiter.c_str(),
- delimiter_size));
-if (pos != nullptr) {
+// search first match delimter_ref index from src
string among str_offset to end
+const char* pos = search.search(str.data + offset +
delimiter_size, n);
+if (pos < str.data + str.size) {
offset = pos - str.data;
num++;
} else {
@@ -1675,10 +1675,10 @@ public:
size_t result, size_t /*input_rows_count*/) override {
DCHECK_EQ(arguments.size(), 2);
-ColumnPtr src_column =
-
block.get_by_position(arguments[0]).column->convert_to_full_column_if_const();
-ColumnPtr delimiter_column =
-
block.get_by_position(arguments[1]).column->convert_to_full_column_if_const();
+const auto& [src_column, left_const] =
+unpack_if_const(block.get_by_position(arguments[0]).column);
+const auto& [right_column, right_const] =
+unpack_if_const(block.get_by_position(arguments[1]).column);
DataTypePtr src_column_type = block.get_by_position(arguments[0]).type;
auto dest_column_ptr =
ColumnArray::create(make_nullable(src_column_type)->create_column(),
@@ -1695,16 +1695,93 @@ public:
dest_nested_column = dest_nullable_col->get_nested_column_ptr();
dest_nested_null_map =
&dest_nullable_col->get_null_map_column().get_data();
-_execute(*src_column, *delimiter_column, *dest_nested_column,
dest_offsets,
- dest_nested_null_map);
-block.replace_by_position(result, std::move(dest_column_ptr));
-return Status::OK();
+if (auto col_left =
check_and_get_column(src_column.get())) {
+if (auto col_right =
check_and_get_column(right_column.get())) {
+if (right_const) {
+_execute_constant(*col_left, col_right->get_data_at(0),
*dest_nested_column,
+ dest_offsets, dest_nested_null_map);
+} else {
+_execute_vector(*col_left, *col_right,
*dest_nested_column, dest_offsets,
+dest_nested_null_map);
+}
+
+block.replace_by_position(result, std::move(dest_column_ptr));
+return Status::OK();
+}
+}
+return Status::RuntimeError("unimplements function {}", get_name());
}
private:
-void _execute(const IColumn& src_column, const IColumn& delimiter_column,
- IColumn& dest_nested_column, ColumnArray::Offsets64&
dest_offsets,
- NullMapType* dest_nested_null_map) {
+void _execute_constant(const ColumnString& src_column_string, const
StringRef& delimiter_ref,
[GitHub] [doris] yongjinhou commented on pull request #18519: [feature-wip](resource-group) Support resource group tvf
yongjinhou commented on PR #18519: URL: https://github.com/apache/doris/pull/18519#issuecomment-1502855941 run compile -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] inventertom commented on issue #18489: [Bug] Jdbc connector _register_func_id meet error and error is NoSuchMethodError: convert Date To Long
inventertom commented on issue #18489: URL: https://github.com/apache/doris/issues/18489#issuecomment-1502865443 java-udf-jar-with-denpendencies.jar updated to version 1.2.3， Download from the official website， now , Three attempts to execute will succeed once，report the same error,  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Mryange commented on pull request #18486: [feature](function) Add new parameters to 'trim'.
Mryange commented on PR #18486: URL: https://github.com/apache/doris/pull/18486#issuecomment-1502876884 run feut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated: [enhancement](nereids) Forbid analyze view (#18522)
This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 0ef958f228 [enhancement](nereids) Forbid analyze view (#18522)
0ef958f228 is described below
commit 0ef958f228ab6bb95b12d903539d85ee5ecec00c
Author: AKIRA <33112463+kikyou1...@users.noreply.github.com>
AuthorDate: Tue Apr 11 17:11:06 2023 +0900
[enhancement](nereids) Forbid analyze view (#18522)
---
fe/fe-core/src/main/java/org/apache/doris/analysis/AnalyzeStmt.java | 5 -
1 file changed, 4 insertions(+), 1 deletion(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/analysis/AnalyzeStmt.java
b/fe/fe-core/src/main/java/org/apache/doris/analysis/AnalyzeStmt.java
index bdbbc6763f..fe0b8bab2b 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/analysis/AnalyzeStmt.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/analysis/AnalyzeStmt.java
@@ -24,6 +24,7 @@ import org.apache.doris.catalog.Env;
import org.apache.doris.catalog.OlapTable;
import org.apache.doris.catalog.Partition;
import org.apache.doris.catalog.TableIf;
+import org.apache.doris.catalog.View;
import org.apache.doris.common.AnalysisException;
import org.apache.doris.common.Config;
import org.apache.doris.common.ErrorCode;
@@ -110,7 +111,9 @@ public class AnalyzeStmt extends DdlStmt {
DatabaseIf db = catalog.getDbOrAnalysisException(dbName);
dbId = db.getId();
table = db.getTableOrAnalysisException(tblName);
-
+if (table instanceof View) {
+throw new AnalysisException("Analyze view is not allowed");
+}
checkAnalyzePriv(dbName, tblName);
if (columnNames != null && !columnNames.isEmpty()) {
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] morrySnow merged pull request #18522: [enhancement](nereids) Forbid analyze view
morrySnow merged PR #18522: URL: https://github.com/apache/doris/pull/18522 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] freemandealer commented on pull request #18528: [fix](storage) free dict_page immediately after usage to save memory
freemandealer commented on PR #18528: URL: https://github.com/apache/doris/pull/18528#issuecomment-1502886820 build all -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] adonis0147 opened a new pull request, #18552: [Fix](cpp17) fix gutil unary_function binary_function for cpp17 (#16670)
adonis0147 opened a new pull request, #18552: URL: https://github.com/apache/doris/pull/18552 # Proposed changes Backport #16670 ## Checklist(Required) * [ ] Does it affect the original behavior * [ ] Has unit tests been added * [ ] Has document been added or modified * [ ] Does it need to update dependencies * [ ] Is this PR support rollback (If NO, please explain WHY) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris-thirdparty] adonis0147 merged pull request #53: [chore] Porting to GCC 12.2
adonis0147 merged PR #53: URL: https://github.com/apache/doris-thirdparty/pull/53 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-thirdparty] branch clucene updated: [chore] Porting to GCC 12.2 (#53)
This is an automated email from the ASF dual-hosted git repository.
adonisling pushed a commit to branch clucene
in repository https://gitbox.apache.org/repos/asf/doris-thirdparty.git
The following commit(s) were added to refs/heads/clucene by this push:
new 031f8f7 [chore] Porting to GCC 12.2 (#53)
031f8f7 is described below
commit 031f8f772179f85796833e0982d34defee191f6b
Author: Adonis Ling
AuthorDate: Tue Apr 11 16:22:38 2023 +0800
[chore] Porting to GCC 12.2 (#53)
Currently, some errors occur when building clucene by GCC-12.2. This PR
fixes these errors.
---
.github/workflows/build.yml | 2 +-
src/ext/for/bitutil.c | 6 +++---
src/ext/for/bitutil.h | 4 ++--
3 files changed, 6 insertions(+), 6 deletions(-)
diff --git a/.github/workflows/build.yml b/.github/workflows/build.yml
index aaa65fb..64386c9 100644
--- a/.github/workflows/build.yml
+++ b/.github/workflows/build.yml
@@ -91,7 +91,7 @@ jobs:
brew update
popd
-brew install ${{ matrix.config.packages }}
+brew install ${{ matrix.config.packages }} || true
CELLARS=(${{ matrix.config.packages }})
for cellar in "${CELLARS[@]}"; do
diff --git a/src/ext/for/bitutil.c b/src/ext/for/bitutil.c
index 6486bae..1e4e80b 100644
--- a/src/ext/for/bitutil.c
+++ b/src/ext/for/bitutil.c
@@ -122,7 +122,7 @@ uint16_t bitd16(uint16_t *in, unsigned n, uint16_t *px,
uint16_t start) {
vo1 = _mm_or_si128(vo1, v1);
vx0 = _mm_or_si128(vx0, _mm_xor_si128(v0, vb0));
vx1 = _mm_or_si128(vx1, _mm_xor_si128(v1, vb0));
- }
start = _mm_cvtsi128_si16(_mm_srli_si128(vs,14));
+ }
start = mm_cvtsi128_si16(_mm_srli_si128(vs,14));
vo0 = _mm_or_si128(vo0, vo1); o = mm_hor_epi16(vo0);
vx0 = _mm_or_si128(vx0, vx1); x = mm_hor_epi16(vx0);
#else
@@ -443,7 +443,7 @@ uint16_t bitz16(uint16_t *in, unsigned n, uint16_t *px,
uint16_t start) {
vo1 = _mm_or_si128(vo1, v1);
vx0 = _mm_or_si128(vx0, _mm_xor_si128(v0, vb0));
vx1 = _mm_or_si128(vx1, _mm_xor_si128(v1, vb0));
- }
start = _mm_cvtsi128_si16(_mm_srli_si128(vs,14));
+ }
start = mm_cvtsi128_si16(_mm_srli_si128(vs,14));
vo0 = _mm_or_si128(vo0, vo1); o = mm_hor_epi16(vo0);
vx0 = _mm_or_si128(vx0, vx1); x = mm_hor_epi16(vx0);
#else
@@ -488,7 +488,7 @@ uint32_t bitz32(unsigned *in, unsigned n, uint32_t *px,
unsigned start) {
vo1 = _mm_or_si128(vo1, v1);
vx0 = _mm_or_si128(vx0, _mm_xor_si128(v0, vb0));
vx1 = _mm_or_si128(vx1, _mm_xor_si128(v1, vb0));
- }
start = _mm_cvtsi128_si16(_mm_srli_si128(vs,12));
+ }
start = mm_cvtsi128_si16(_mm_srli_si128(vs,12));
vo0 = _mm_or_si128(vo0, vo1); o = mm_hor_epi32(vo0);
vx0 = _mm_or_si128(vx0, vx1); x = mm_hor_epi32(vx0);
#else
diff --git a/src/ext/for/bitutil.h b/src/ext/for/bitutil.h
index 7428060..50506fc 100644
--- a/src/ext/for/bitutil.h
+++ b/src/ext/for/bitutil.h
@@ -188,8 +188,8 @@ static ALWAYS_INLINE uint64_t mm_hor_epi64( __m128i v) { v
= _mm_or_si128( v, _m
#define ADDI32x4(_v_, _sv_, _vi_) _sv_ = _mm_add_epi32(_mm_add_epi32(_sv_,
_vi_),_v_)
// Convert _mm_cvtsi128_siXX
---
-static ALWAYS_INLINE uint8_t _mm_cvtsi128_si8 (__m128i v) { return (uint8_t
)_mm_cvtsi128_si32(v); }
-static ALWAYS_INLINE uint16_t _mm_cvtsi128_si16(__m128i v) { return
(uint16_t)_mm_cvtsi128_si32(v); }
+static ALWAYS_INLINE uint8_t mm_cvtsi128_si8 (__m128i v) { return (uint8_t
)_mm_cvtsi128_si32(v); }
+static ALWAYS_INLINE uint16_t mm_cvtsi128_si16(__m128i v) { return
(uint16_t)_mm_cvtsi128_si32(v); }
#endif
//- memset -
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yangzhg opened a new pull request, #18553: [chore](ARM) Add some vectorization compatibility code on aarch64
yangzhg opened a new pull request, #18553: URL: https://github.com/apache/doris/pull/18553 # Proposed changes Issue Number: close #xxx ## Problem summary add some vectorization compatibility code on aarch64 ## Checklist(Required) * [ ] Does it affect the original behavior * [ ] Has unit tests been added * [ ] Has document been added or modified * [x] Does it need to update dependencies * [ ] Is this PR support rollback (If NO, please explain WHY) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Mryange commented on pull request #18486: [feature](function) Add new parameters to 'trim'.
Mryange commented on PR #18486: URL: https://github.com/apache/doris/pull/18486#issuecomment-1502904172 run beut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] CalvinKirs opened a new pull request, #18554: [improve][fe]Optimize fe binary package packaging
CalvinKirs opened a new pull request, #18554: URL: https://github.com/apache/doris/pull/18554 Binary packages do not need to provide or test level dependencies. We use maven dependency-copy to copy binary dependencies, but this plugin will package test-level dependencies by default, refer to: `````` # Proposed changes Here is the diff after repacking ``` HdrHistogram-2.1.9.jar HdrHistogram-2.1.9.jar RoaringBitmap-0.8.13.jar RoaringBitmap-0.8.13.jar accessors-smart-2.4.8.jar accessors-smart-2.4.8.jar activation-1.1.1.jar < aggs-matrix-stats-client-7.6.0.jar aggs-matrix-stats-client-7.6.0.jar aircompressor-0.21.jar aircompressor-0.21.jar amqp-client-5.14.2.jar< animal-sniffer-annotations-1.18.jar animal-sniffer-annotations-1.18.jar annotations-13.0.jar annotations-13.0.jar annotations-2.17.257.jar annotations-2.17.257.jar annotations-4.1.1.4.jar annotations-4.1.1.4.jar ant-1.10.12.jar ant-1.10.12.jar ant-launcher-1.10.12.jar ant-launcher-1.10.12.jar antlr4-runtime-4.9.3.jar antlr4-runtime-4.9.3.jar apiguardian-api-1.1.2.jar < arns-2.17.257.jar arns-2.17.257.jar arrow-format-0.10.0.jar < arrow-memory-0.10.0.jar < arrow-vector-0.10.0.jar < asm-3.1.jar asm-3.1.jar asm-9.2.jar asm-9.2.jar asm-commons-9.4.jar asm-commons-9.4.jar asm-tree-9.4.jar asm-tree-9.4.jar aspectjrt-1.9.7.jar aspectjrt-1.9.7.jar aspectjweaver-1.9.7.jar aspectjweaver-1.9.7.jar audience-annotations-0.5.0.jar audience-annotations-0.5.0.jar auth-2.17.257.jar auth-2.17.257.jar automaton-1.11-8.jar automaton-1.11-8.jar avro-1.10.1.jar avro-1.10.1.jar avro-ipc-1.8.2.jar< avro-mapred-1.8.2-hadoop2.jar < awaitility-4.0.3.jar awaitility-4.0.3.jar aws-core-2.17.257.jar aws-core-2.17.257.jar aws-java-sdk-bundle-1.12.125.jar aws-java-sdk-bundle-1.12.125.jar aws-java-sdk-core-1.12.302.jar aws-java-sdk-core-1.12.302.jar aws-java-sdk-dynamodb-1.12.302.jar aws-java-sdk-dynamodb-1.12.302.jar aws-java-sdk-glue-1.12.302.jar aws-java-sdk-glue-1.12.302.jar aws-java-sdk-kms-1.12.302.jar aws-java-sdk-kms-1.12.302.jar aws-java-sdk-s3-1.12.302.jar aws-java-sdk-s3-1.12.302.jar aws-json-protocol-2.17.257.jar aws-json-protocol-2.17.257.jar aws-query-protocol-2.17.257.jar aws-query-protocol-2.17.257.jar aws-xml-protocol-2.17.257.jar aws-xml-protocol-2.17.257.jar bcpkix-jdk15on-1.65.jar bcpkix-jdk15on-1.65.jar bcprov-jdk15on-1.65.jar bcprov-jdk15on-1.65.jar caffeine-2.9.3.jar caffeine-2.9.3.jar canal.client-1.1.6.jar canal.client-1.1.6.jar canal.common-1.1.6.jar canal.common-1.1.6.jar canal.protocol-1.1.6.jar
runtimescope gives runtime and compile dependencies,compilescope gives compile, provided, and system dependencies,test(default) scope gives all dependencies,providedscope just gives provided dependencies,systemscope just gives system dependencies.
[GitHub] [doris] github-actions[bot] commented on a diff in pull request #18553: [chore](ARM) Add some vectorization compatibility code on aarch64
github-actions[bot] commented on code in PR #18553:
URL: https://github.com/apache/doris/pull/18553#discussion_r1162473831
##
be/src/util/cityhash102/city.cc:
##
@@ -100,373 +101,366 @@ static const uint64 k3 = 0xc949d7c7509e6557ULL;
// Bitwise right rotate. Normally this will compile to a single
// instruction, especially if the shift is a manifest constant.
static uint64 Rotate(uint64 val, int shift) {
- // Avoid shifting by 64: doing so yields an undefined result.
- return shift == 0 ? val : ((val >> shift) | (val << (64 - shift)));
+// Avoid shifting by 64: doing so yields an undefined result.
+return shift == 0 ? val : ((val >> shift) | (val << (64 - shift)));
}
// Equivalent to Rotate(), but requires the second arg to be non-zero.
// On x86-64, and probably others, it's possible for this to compile
// to a single instruction if both args are already in registers.
static uint64 RotateByAtLeast1(uint64 val, int shift) {
- return (val >> shift) | (val << (64 - shift));
+return (val >> shift) | (val << (64 - shift));
}
static uint64 ShiftMix(uint64 val) {
- return val ^ (val >> 47);
+return val ^ (val >> 47);
}
static uint64 HashLen16(uint64 u, uint64 v) {
- return Hash128to64(uint128(u, v));
+return Hash128to64(uint128(u, v));
}
-static uint64 HashLen0to16(const char *s, size_t len) {
- if (len > 8) {
-uint64 a = Fetch64(s);
-uint64 b = Fetch64(s + len - 8);
-return HashLen16(a, RotateByAtLeast1(b + len, len)) ^ b;
- }
- if (len >= 4) {
-uint64 a = Fetch32(s);
-return HashLen16(len + (a << 3), Fetch32(s + len - 4));
- }
- if (len > 0) {
-uint8 a = s[0];
-uint8 b = s[len >> 1];
-uint8 c = s[len - 1];
-uint32 y = static_cast(a) + (static_cast(b) << 8);
-uint32 z = len + (static_cast(c) << 2);
-return ShiftMix(y * k2 ^ z * k3) * k2;
- }
- return k2;
+static uint64 HashLen0to16(const char* s, size_t len) {
+if (len > 8) {
+uint64 a = Fetch64(s);
+uint64 b = Fetch64(s + len - 8);
+return HashLen16(a, RotateByAtLeast1(b + len, len)) ^ b;
+}
+if (len >= 4) {
+uint64 a = Fetch32(s);
+return HashLen16(len + (a << 3), Fetch32(s + len - 4));
+}
+if (len > 0) {
+uint8 a = s[0];
+uint8 b = s[len >> 1];
+uint8 c = s[len - 1];
+uint32 y = static_cast(a) + (static_cast(b) << 8);
+uint32 z = len + (static_cast(c) << 2);
+return ShiftMix(y * k2 ^ z * k3) * k2;
+}
+return k2;
}
// This probably works well for 16-byte strings as well, but it may be overkill
// in that case.
-static uint64 HashLen17to32(const char *s, size_t len) {
- uint64 a = Fetch64(s) * k1;
- uint64 b = Fetch64(s + 8);
- uint64 c = Fetch64(s + len - 8) * k2;
- uint64 d = Fetch64(s + len - 16) * k0;
- return HashLen16(Rotate(a - b, 43) + Rotate(c, 30) + d,
- a + Rotate(b ^ k3, 20) - c + len);
+static uint64 HashLen17to32(const char* s, size_t len) {
+uint64 a = Fetch64(s) * k1;
+uint64 b = Fetch64(s + 8);
+uint64 c = Fetch64(s + len - 8) * k2;
+uint64 d = Fetch64(s + len - 16) * k0;
+return HashLen16(Rotate(a - b, 43) + Rotate(c, 30) + d, a + Rotate(b ^ k3,
20) - c + len);
}
// Return a 16-byte hash for 48 bytes. Quick and dirty.
// Callers do best to use "random-looking" values for a and b.
static std::pair WeakHashLen32WithSeeds(uint64 w, uint64 x,
uint64 y, uint64 z,
uint64 a, uint64 b) {
- a += w;
- b = Rotate(b + a + z, 21);
- uint64 c = a;
- a += x;
- a += y;
- b += Rotate(a, 44);
- return std::make_pair(a + z, b + c);
+a += w;
+b = Rotate(b + a + z, 21);
+uint64 c = a;
+a += x;
+a += y;
+b += Rotate(a, 44);
+return std::make_pair(a + z, b + c);
}
// Return a 16-byte hash for s[0] ... s[31], a, and b. Quick and dirty.
static std::pair WeakHashLen32WithSeeds(const char* s, uint64
a, uint64 b) {
- return WeakHashLen32WithSeeds(Fetch64(s), Fetch64(s + 8), Fetch64(s + 16),
Fetch64(s + 24), a, b);
+return WeakHashLen32WithSeeds(Fetch64(s), Fetch64(s + 8), Fetch64(s + 16),
Fetch64(s + 24), a,
+ b);
}
// Return an 8-byte hash for 33 to 64 bytes.
-static uint64 HashLen33to64(const char *s, size_t len) {
- uint64 z = Fetch64(s + 24);
- uint64 a = Fetch64(s) + (len + Fetch64(s + len - 16)) * k0;
- uint64 b = Rotate(a + z, 52);
- uint64 c = Rotate(a, 37);
- a += Fetch64(s + 8);
- c += Rotate(a, 7);
- a += Fetch64(s + 16);
- uint64 vf = a + z;
- uint64 vs = b + Rotate(a, 31) + c;
- a = Fetch64(s + 16) + Fetch64(s + len - 32);
- z = Fetch64(s + len - 8);
- b = Rotate(a + z, 52);
- c = Rotate(a, 37);
- a += Fetch64(s + len - 24);
- c += Rotate(a, 7);
- a += Fetch64(s + len - 16);
- uint64 wf = a + z;
- uint64 ws = b + Rotate(a, 31) + c;
- uint64 r = ShiftMix((vf + ws) * k2 + (wf + vs) * k0);
- return ShiftMix(r * k0
[GitHub] [doris] CalvinKirs commented on pull request #18554: [improve](fe)Optimize fe binary package packaging
CalvinKirs commented on PR #18554: URL: https://github.com/apache/doris/pull/18554#issuecomment-1502911261 For those dependencies that were previously scoped to provide, I modified the scope of the dependencies. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] jackwener merged pull request #18511: [feat](Nereids): a new CBO rule: Eager Count/GroupBy.
jackwener merged PR #18511: URL: https://github.com/apache/doris/pull/18511 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated (0ef958f228 -> 25008bbf7f)
This is an automated email from the ASF dual-hosted git repository. jakevin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 0ef958f228 [enhancement](nereids) Forbid analyze view (#18522) add 25008bbf7f [feat](Nereids): a new CBO rule: Eager Count/GroupBy. (#18511) No new revisions were added by this update. Summary of changes: .../org/apache/doris/nereids/rules/RuleType.java | 2 + .../nereids/rules/exploration/EagerCount.java | 108 .../nereids/rules/exploration/EagerGroupBy.java| 113 + .../trees/plans/logical/LogicalAggregate.java | 14 ++- .../nereids/rules/exploration/EagerCountTest.java | 88 .../rules/exploration/EagerGroupByTest.java| 88 6 files changed, 411 insertions(+), 2 deletions(-) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/EagerCount.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/EagerGroupBy.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/exploration/EagerCountTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/exploration/EagerGroupByTest.java - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris-thirdparty] annotated tag libclucene-v2.4.9 updated (031f8f7 -> 2e8cbb7)
This is an automated email from the ASF dual-hosted git repository. adonisling pushed a change to annotated tag libclucene-v2.4.9 in repository https://gitbox.apache.org/repos/asf/doris-thirdparty.git *** WARNING: tag libclucene-v2.4.9 was modified! *** from 031f8f7 (commit) to 2e8cbb7 (tag) tagging 031f8f772179f85796833e0982d34defee191f6b (commit) replaces libclucene-v2.4.8 by Adonis Ling on Tue Apr 11 16:37:33 2023 +0800 - Log - libclucene-v2.4.9 --- No new revisions were added by this update. Summary of changes: - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] CalvinKirs commented on pull request #18554: [improve](fe)Optimize fe binary package packaging
CalvinKirs commented on PR #18554: URL: https://github.com/apache/doris/pull/18554#issuecomment-1502921550 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] jackwener opened a new pull request, #18556: [feat](Nereids): a new CBO rule: Eager Split/GroupByCount
jackwener opened a new pull request, #18556: URL: https://github.com/apache/doris/pull/18556 # Proposed changes Issue Number: close #xxx ## Problem summary a new CBO rule: Eager Split/GroupByCount ## Checklist(Required) * [x] Does it affect the original behavior * [ ] Has unit tests been added * [ ] Has document been added or modified * [ ] Does it need to update dependencies * [ ] Is this PR support rollback (If NO, please explain WHY) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #17753: [Enhancement](HttpServer) Add http interface authentication for BE
github-actions[bot] commented on PR #17753: URL: https://github.com/apache/doris/pull/17753#issuecomment-1502924293 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18524: [tpch](nereids) update semi/anti estimation algorithm
github-actions[bot] commented on PR #18524: URL: https://github.com/apache/doris/pull/18524#issuecomment-1502928029 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18524: [tpch](nereids) update semi/anti estimation algorithm
github-actions[bot] commented on PR #18524: URL: https://github.com/apache/doris/pull/18524#issuecomment-1502928099 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] wzymumon opened a new pull request, #18557: [feature](array function) support array_count function (#17313)
wzymumon opened a new pull request, #18557: URL: https://github.com/apache/doris/pull/18557 # Proposed changes Issue Number: close #17313 ## Problem summary support array_count function. array_count：Returns the number of non-zero and non-null elements in the given array. ``` mysql> select array_count([]); +--+ | array_count(ARRAY()) | +--+ |0 | +--+ 1 row in set (0.02 sec) mysql> select array_count([0,0,1,2,4,8,16,32]); +--+ | array_count(ARRAY(0, 0, 1, 2, 4, 8, 16, 32)) | +--+ |6 | +--+ 1 row in set (0.01 sec) mysql> select array_count([0,0,0,0]); ++ | array_count(ARRAY(0, 0, 0, 0)) | ++ | 0 | ++ 1 row in set (0.01 sec) mysql> select array_count([null, null, null]); +--+ | array_count(ARRAY(NULL, NULL, NULL)) | +--+ |0 | +--+ 1 row in set (0.00 sec) mysql> select array_count(NULL); +---+ | array_count(NULL) | +---+ | NULL | +---+ 1 row in set (0.01 sec) ``` ## Checklist(Required) * [x] Does it affect the original behavior * [x] Has unit tests been added * [x] Has document been added or modified * [ ] Does it need to update dependencies * [ ] Is this PR support rollback (If NO, please explain WHY) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yongjinhou commented on pull request #18558: [doc](https) Add https certificate docs
yongjinhou commented on PR #18558: URL: https://github.com/apache/doris/pull/18558#issuecomment-1502931664 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yongjinhou opened a new pull request, #18558: [doc](https) Add https certificate docs
yongjinhou opened a new pull request, #18558: URL: https://github.com/apache/doris/pull/18558 # Proposed changes Issue Number: close #xxx ## Problem summary Add FE https interface certificate configuration description. ## Checklist(Required) * [ ] Does it affect the original behavior * [ ] Has unit tests been added * [x] Has document been added or modified * [ ] Does it need to update dependencies * [x] Is this PR support rollback (If NO, please explain WHY) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] morrySnow merged pull request #18524: [tpch](nereids) update semi/anti estimation algorithm
morrySnow merged PR #18524: URL: https://github.com/apache/doris/pull/18524 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated (25008bbf7f -> 79cd50e1ff)
This is an automated email from the ASF dual-hosted git repository. morrysnow pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 25008bbf7f [feat](Nereids): a new CBO rule: Eager Count/GroupBy. (#18511) add 79cd50e1ff [enhancement](statistics) update semi/anti cardinality estimation algorithm (#18524) No new revisions were added by this update. Summary of changes: .../apache/doris/nereids/stats/JoinEstimation.java | 31 -- 1 file changed, 17 insertions(+), 14 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18557: [feature](array function) support array_count function (#17313)
github-actions[bot] commented on PR #18557: URL: https://github.com/apache/doris/pull/18557#issuecomment-1502933606 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] morningman commented on issue #18535: [Feature] Routine load process with a exist group id
morningman commented on issue #18535: URL: https://github.com/apache/doris/issues/18535#issuecomment-1502936379 Sounds reasonable -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yongjinhou commented on pull request #18519: [feature-wip](resource-group) Support resource group tvf
yongjinhou commented on PR #18519: URL: https://github.com/apache/doris/pull/18519#issuecomment-1502944006 run beut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yongjinhou commented on pull request #18519: [feature-wip](resource-group) Support resource group tvf
yongjinhou commented on PR #18519: URL: https://github.com/apache/doris/pull/18519#issuecomment-1502944385 run feut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #18531: [chore](orc) Update orc lib to third party lib(1.8.3) using git submodule.
hello-stephen commented on PR #18531: URL: https://github.com/apache/doris/pull/18531#issuecomment-1502946667 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 32.21 seconds stream load tsv: 424 seconds loaded 74807831229 Bytes, about 168 MB/s stream load json: 23 seconds loaded 2358488459 Bytes, about 97 MB/s stream load orc: 71 seconds loaded 1101869774 Bytes, about 14 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230411090103_clickbench_pr_127441.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] adonis0147 opened a new issue, #18559: [Bug] Failed to build clucene by GCC 12.2
adonis0147 opened a new issue, #18559:
URL: https://github.com/apache/doris/issues/18559
### Search before asking
- [X] I had searched in the
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no
similar issues.
### Version
Doris version: master
OS: Centos 6
Compiler: GCC 12.2
### What's Wrong?
```shell
[20/212] Original Turbo-PFOR makefile target
FAILED: CMakeFiles/build_ic
/Programs/doris/thirdparty/src/doris-thirdparty-libclucene-v2.4.8/doris_build/CMakeFiles/build_ic
cd
/Programs/doris/thirdparty/src/doris-thirdparty-libclucene-v2.4.8/src/ext/for
&& make OPT='-Wno-implicit-function-declaration -Wno-implicit-int
-Wno-int-conversion' USE_AVX2=1 libic.a -j 8
/devel/compiler/bin/../bin/gcc -O3 -w -mavx2 -DAVX2_ON
-Wno-implicit-function-declaration -Wno-implicit-int -Wno-int-conversion -c
bitpack.c -o bitpack_avx2.o
/devel/compiler/bin/../bin/gcc -O3 -w -mavx2 -DAVX2_ON
-Wno-implicit-function-declaration -Wno-implicit-int -Wno-int-conversion -c
bitunpack.c -o bitunpack_avx2.o
/devel/compiler/bin/../bin/gcc -O3 -w -mavx2 -DAVX2_ON
-Wno-implicit-function-declaration -Wno-implicit-int -Wno-int-conversion -c
vp4c.c -o vp4c_avx2.o
/devel/compiler/bin/../bin/gcc -O3 -w -mavx2 -DAVX2_ON
-Wno-implicit-function-declaration -Wno-implicit-int -Wno-int-conversion -c
vp4d.c -o vp4d_avx2.o
/devel/compiler/bin/../bin/gcc -O3 -w -mavx2 -DAVX2_ON
-Wno-implicit-function-declaration -Wno-implicit-int -Wno-int-conversion -c
transpose.c -o transpose_avx2.o
In file included from bitpack.c:30:
bitutil.h:192:31: error: conflicting types for '_mm_cvtsi128_si16'; have
'uint16_t(__m128i)' {aka 'short unsigned int(__m128i)'}
192 | static ALWAYS_INLINE uint16_t _mm_cvtsi128_si16(__m128i v) { return
(uint16_t)_mm_cvtsi128_si32(v); }
| ^
In file included from
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/immintrin.h:98,
from
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/x86intrin.h:32,
from conf.h:232,
from bitpack.c:29:
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/avx512fp16intrin.h:2746:1:
note: previous definition of '_mm_cvtsi128_si16' with type 'short int(__m128i)'
2746 | _mm_cvtsi128_si16 (__m128i __A)
| ^
In file included from vp4d.c:36:
bitutil.h:192:31: error: conflicting types for '_mm_cvtsi128_si16'; have
'uint16_t(__m128i)' {aka 'short unsigned int(__m128i)'}
192 | static ALWAYS_INLINE uint16_t _mm_cvtsi128_si16(__m128i v) { return
(uint16_t)_mm_cvtsi128_si32(v); }
| ^
In file included from
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/immintrin.h:98,
from
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/x86intrin.h:32,
from conf.h:232,
from vp4d.c:35:
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/avx512fp16intrin.h:2746:1:
note: previous definition of '_mm_cvtsi128_si16' with type 'short int(__m128i)'
2746 | _mm_cvtsi128_si16 (__m128i __A)
| ^
In file included from bitunpack.c:28:
bitutil.h:192:31: error: conflicting types for '_mm_cvtsi128_si16'; have
'uint16_t(__m128i)' {aka 'short unsigned int(__m128i)'}
192 | static ALWAYS_INLINE uint16_t _mm_cvtsi128_si16(__m128i v) { return
(uint16_t)_mm_cvtsi128_si32(v); }
| ^
In file included from
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/immintrin.h:98,
from
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/x86intrin.h:32,
from conf.h:232,
from bitunpack.c:27:
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/avx512fp16intrin.h:2746:1:
note: previous definition of '_mm_cvtsi128_si16' with type 'short int(__m128i)'
2746 | _mm_cvtsi128_si16 (__m128i __A)
| ^
In file included from vp4c.c:36:
bitutil.h:192:31: error: conflicting types for '_mm_cvtsi128_si16'; have
'uint16_t(__m128i)' {aka 'short unsigned int(__m128i)'}
192 | static ALWAYS_INLINE uint16_t _mm_cvtsi128_si16(__m128i v) { return
(uint16_t)_mm_cvtsi128_si32(v); }
| ^
In file included from
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/immintrin.h:98,
from
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/x86intrin.h:32,
from conf.h:232,
from vp4c.c:33:
/devel/compiler/lib/gcc/x86_64-linux-gnu/12.2.0/include/avx512fp16intrin.h:2746:1:
note: previous definition of '_mm_cvtsi128_si16' with type 'short int(__m128i)'
2746 | _mm_cvtsi128_si16 (__m128i __A)
| ^
make:
[GitHub] [doris] adonis0147 opened a new pull request, #18560: [chore](third-party) Porting to GCC-12
adonis0147 opened a new pull request, #18560: URL: https://github.com/apache/doris/pull/18560 # Proposed changes Issue Number: close #18559 ## Problem summary The definitions of `_mm_cvtsi128_si16` conflicts. ## Checklist(Required) * [ ] Does it affect the original behavior * [ ] Has unit tests been added * [ ] Has document been added or modified * [x] Does it need to update dependencies * [ ] Is this PR support rollback (If NO, please explain WHY) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris-spark-connector] gnehil opened a new pull request, #95: [feature] Add the date format parameter to control the output of timestamp type data
gnehil opened a new pull request, #95: URL: https://github.com/apache/doris-spark-connector/pull/95 …stamp type # Proposed changes Issue Number: close #xxx ## Problem Summary: 1. Add new parameters `doris.sink.enable-date-format` and `doris.sink.date-format-pattern` to format timestamp type data to avoid loading failure when loading datetime column with not null attribute. 2. Reorganized the constructor of the `DorisStreamLoad` class. ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 3. Has unit tests been added: (Yes/No/No Need) 4. Has document been added or modified: (Yes/No/No Need) 5. Does it need to update dependencies: (Yes/No) 6. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Gabriel39 commented on pull request #18336: [Bug](DECIMALV3) report failure if a decimal value is overflow
Gabriel39 commented on PR #18336: URL: https://github.com/apache/doris/pull/18336#issuecomment-1502982056 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Gabriel39 merged pull request #18540: [minor](refactor) delete unused codes
Gabriel39 merged PR #18540: URL: https://github.com/apache/doris/pull/18540 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[doris] branch master updated (79cd50e1ff -> 5aac346ca4)
This is an automated email from the ASF dual-hosted git repository. gabriellee pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 79cd50e1ff [enhancement](statistics) update semi/anti cardinality estimation algorithm (#18524) add 5aac346ca4 [minor](refactor) delete unused codes (#18540) No new revisions were added by this update. Summary of changes: be/src/pipeline/exec/meta_scan_operator.cpp | 37 --- be/src/pipeline/exec/meta_scan_operator.h | 46 - 2 files changed, 83 deletions(-) delete mode 100644 be/src/pipeline/exec/meta_scan_operator.cpp delete mode 100644 be/src/pipeline/exec/meta_scan_operator.h - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] jackwener commented on pull request #18556: [feat](Nereids): a new CBO rule: Eager Split/GroupByCount
jackwener commented on PR #18556: URL: https://github.com/apache/doris/pull/18556#issuecomment-1502987309 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18336: [Bug](DECIMALV3) report failure if a decimal value is overflow
github-actions[bot] commented on PR #18336: URL: https://github.com/apache/doris/pull/18336#issuecomment-1502988107 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt opened a new pull request, #18561: [Bug](materialized-view) fix match wrong index on some scan node
BiteThet opened a new pull request, #18561: URL: https://github.com/apache/doris/pull/18561 # Proposed changes ```cpp 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /mnt/disk1/yuejing/projects/doris/be/src/common/signal_handler.h:413 1# 0x7FBF7616B0C0 in /lib/x86_64-linux-gnu/libc.so.6 2# raise in /lib/x86_64-linux-gnu/libc.so.6 3# abort in /lib/x86_64-linux-gnu/libc.so.6 4# 0x562D0D41BDD9 in /home/ubuntu/doris_master/output/be/lib/doris_be 5# 0x562D0D4113ED in /home/ubuntu/doris_master/output/be/lib/doris_be 6# google::LogMessage::SendToLog() in /home/ubuntu/doris_master/output/be/lib/doris_be 7# google::LogMessage::Flush() in /home/ubuntu/doris_master/output/be/lib/doris_be 8# google::LogMessageFatal::~LogMessageFatal() in /home/ubuntu/doris_master/output/be/li b/doris_be 9# doris::vectorized::IColumn::get_raw_data() const in /home/ubuntu/doris_master/output/ be/lib/doris_be 10# doris::vectorized::ColumnVector::insert_indices_from(doris::vectorized::IColumn const&, int const*, int const*) at /mnt/disk1/yuejing/projects/doris/be/src/vec/columns/c olumn_vector.cpp:371 11# doris::vectorized::ColumnNullable::insert_indices_from(doris::vectorized::IColumn con st&, int const*, int const*) at /mnt/disk1/yuejing/projects/doris/be/src/vec/columns/column_nullable.cpp:258 12# void doris::vectorized::ProcessHashTableProbe<1>::build_side_output_column(std ::vector::mutable_ptr, std::a llocator::mutable_ptr > >&, i nt, int, std::vector > const&, int) at /mnt/disk1/yuejing/proj ects/doris/be/src/vec/exec/join/process_hash_table_probe_impl.h:71 13# doris::Status doris::vectorized::ProcessHashTableProbe<1>::do_process >(doris::vecto rized::SerializedHashTableContext&, doris::vectorized::POD Array, 15ul, 16ul> const*, doris::vectorized::MutableBlock&, doris::vectorized::Block*, unsigned long, bool) at /mnt/disk1/yuejing/ projects/doris/be/src/vec/exec/join/process_hash_table_probe_impl.h:388 14# auto doris::vectorized::HashJoinNode::pull(doris::RuntimeState*, doris::vectorized::B lock*, bool*)::$_1::operator()&, doris::vectorized::ProcessHashTableProbe<1>&, std::integral_constant, std::integral_constant >(doris::vectorized::SerializedHashTableContext&, doris::vectorized::ProcessHashTableProbe<1>&, s td::integral_constant, std::integral_constant) const at /mnt/dis k1/yuejing/projects/doris/be/src/vec/exec/join/vhash_join_node.cpp:501 15# void std::__invoke_impl&, doris::vectorized::ProcessHashTableProbe<1>&, std::integral_constant, std::integral_constant >(std::_invoke_other, do ris::vectorized::HashJoinNode::pull(doris::RuntimeState*, doris::vectorized::Block*, bool *)::$_1&&, doris::vectorized::SerializedHashTableContext&, doris::vectorized::ProcessHashTableProbe<1>&, std::integral_constant&&, std: :integral_constant&&) at /mnt/disk1/yuejing/projects/ldb_toolchain/bin/../li b/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:61 16# std::__invoke_result&, doris::vectorized::ProcessHashTableProbe<1>&, std::integral_con stant, std::integral_constant >::type std::__invoke&, doris::vectorized::ProcessHashTableProbe<1>&, std::integral_constant, std::integral_cons tant >(doris::vectorized::HashJoinNode::pull(doris::RuntimeState*, doris::ve ctorized::Block*, bool*)::$_1&&, doris::vectorized::SerializedHashTableContext&, doris::vectorized::ProcessHashTableProbe<1>&, std::integral_consta nt&&, std::integral_constant&&) at /mnt/disk1/yuejing/projects/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h: 96 17# ZNSt8detail9variant17gen_vtable_implINS0_12_Multi_arrayIPFNS0_21deduce_visit_resultIvEEOZN5doris10vectorized12HashJoinNode4pullEPNS5_12RuntimeStateEPNS6_5BlockEPbE3$_1RSt7variantIJSt9monostateNS6_26SerializedHashTableContextINS6_10RowRefListEEENS6_27PrimaryTypeHashTableContextIhSI_EENSK_ItSI_EENSK_IjSI_EENSK_ImSI_EENSK_INS6_7UInt128ESI_EENSK_INS6_7UInt256ESI_EENS6_24FixedKeyHashTableContextImLb1ESI_EENST_ImLb0ESI_EENST_ISP_Lb1ESI_EENST_ISP_Lb0ESI_EENST_ISR_Lb1ESI_EENST_ISR_Lb0ESI_EENSH_INS6_18RowRefListWithFlagEEENSK_IhS10_EENSK_ItS10_EENSK_IjS10_EENSK_ImS10_EENSK_ISP_S10_EENSK_ISR_S10_EENST_ImLb1ES10_EENST_ImLb0ES10_EENST_ISP_Lb1ES10_EENST_ISP_Lb0ES10_EENST_ISR_Lb1ES10_EENST_ISR_Lb0ES10_EENSH_INS6_19RowRefListWithFlagsEEENSK_IhS1E_EENSK_ItS1E_EENSK_IjS1E_EENSK_ImS1E_EENSK_ISP_S1E_EENSK_ISR_S1E_EENST_ImLb1ES1E_EENST_ImLb0ES1E_EENST_ISP_Lb1ES1E_EENST_ISP_Lb0ES1E_EENST_ISR_Lb1ES1E_EENST_ISR_Lb0ES1E_RSF_IJSG_NS6_21ProcessHashTableProbeILi0EEENS1U_ILi2EEENS1U_ILi8EEENS1U_ILi1E EENS1U_ILi4EEENS1U_ILi3EEENS1U_ILi5EEENS1U_ILi7EEENS1U_ILi9EEENS1U_ILi10EOSF_IJSt17integral_constantIbLb0EES27_IbLb1S2B_EJEEESt16integer_sequenceImJLm1ELm4ELm1ELm014visit_invokeESE_S1T_S26_S2B_S2B at /mnt/disk1/yuejing/projects/ldb_toolchain/bin/../l
[GitHub] [doris] LemonLiTree commented on pull request #18526: [feature](GEO)Support read/write WKB/EWKB to gis types
LemonLiTree commented on PR #18526: URL: https://github.com/apache/doris/pull/18526#issuecomment-1502999748 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] BiteTheDDDDt commented on pull request #18561: [Bug](materialized-view) fix match wrong index on some scan node
BiteThet commented on PR #18561: URL: https://github.com/apache/doris/pull/18561#issuecomment-150235 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hf200012 commented on a diff in pull request #18558: [doc](https) Add https certificate docs
hf200012 commented on code in PR #18558:
URL: https://github.com/apache/doris/pull/18558#discussion_r1162556904
##
docs/zh-CN/docs/admin-manual/fe-certificate.md:
##
@@ -0,0 +1,40 @@
+---
+{
+"title": "FE SSL密钥证书配置",
+"language": "zh-CN"
+}
+---
+
+
+
+# SSL密钥证书配置
Review Comment:
add version
SSL密钥证书配置
##
docs/en/docs/admin-manual/fe-certificate.md:
##
@@ -0,0 +1,40 @@
+---
+{
+"title": "FE SSL certificate",
+"language": "en"
+}
+---
+
+
+
+# Certificate Configuration
Review Comment:
add version
Certificate Configuration
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hf200012 commented on a diff in pull request #18558: [doc](https) Add https certificate docs
hf200012 commented on code in PR #18558:
URL: https://github.com/apache/doris/pull/18558#discussion_r1162556904
##
docs/zh-CN/docs/admin-manual/fe-certificate.md:
##
@@ -0,0 +1,40 @@
+---
+{
+"title": "FE SSL密钥证书配置",
+"language": "zh-CN"
+}
+---
+
+
+
+# SSL密钥证书配置
Review Comment:
add version
`
SSL密钥证书配置
`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hf200012 commented on a diff in pull request #18558: [doc](https) Add https certificate docs
hf200012 commented on code in PR #18558:
URL: https://github.com/apache/doris/pull/18558#discussion_r1162556904
##
docs/zh-CN/docs/admin-manual/fe-certificate.md:
##
@@ -0,0 +1,40 @@
+---
+{
+"title": "FE SSL密钥证书配置",
+"language": "zh-CN"
+}
+---
+
+
+
+# SSL密钥证书配置
Review Comment:
add version
```
SSL密钥证书配置
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hf200012 commented on a diff in pull request #18558: [doc](https) Add https certificate docs
hf200012 commented on code in PR #18558:
URL: https://github.com/apache/doris/pull/18558#discussion_r1162557310
##
docs/en/docs/admin-manual/fe-certificate.md:
##
@@ -0,0 +1,40 @@
+---
+{
+"title": "FE SSL certificate",
+"language": "en"
+}
+---
+
+
+
+# Certificate Configuration
Review Comment:
add version
```
Certificate Configuration
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] HappenLee commented on pull request #18457: [Pipeline](exec) Support shared scan in colo agg
HappenLee commented on PR #18457: URL: https://github.com/apache/doris/pull/18457#issuecomment-1503003466 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18526: [feature](GEO)Support read/write WKB/EWKB to gis types
github-actions[bot] commented on PR #18526: URL: https://github.com/apache/doris/pull/18526#issuecomment-1503004071 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] caoliang-web opened a new pull request, #18562: [typo](doc)modify introduction to String Type
caoliang-web opened a new pull request, #18562: URL: https://github.com/apache/doris/pull/18562 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) * [ ] Does it affect the original behavior * [ ] Has unit tests been added * [ ] Has document been added or modified * [ ] Does it need to update dependencies * [ ] Is this PR support rollback (If NO, please explain WHY) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zhangstar333 opened a new pull request, #18563: [refactor](jdbc) refactor jdbc connection num in datasource
zhangstar333 opened a new pull request, #18563: URL: https://github.com/apache/doris/pull/18563 # Proposed changes now maybe jdbc have problem that there are too many connections and they do not release, so change the property of datasource: init = 1, min = 1, max = 10, and idle time is 10 minutes. Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) * [ ] Does it affect the original behavior * [ ] Has unit tests been added * [ ] Has document been added or modified * [ ] Does it need to update dependencies * [ ] Is this PR support rollback (If NO, please explain WHY) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] adonis0147 commented on pull request #18560: [chore](third-party) Porting to GCC-12
adonis0147 commented on PR #18560: URL: https://github.com/apache/doris/pull/18560#issuecomment-1503007303 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #17828: [improvement](fetch data) Merge result into batch to reduce rpc times
github-actions[bot] commented on PR #17828: URL: https://github.com/apache/doris/pull/17828#issuecomment-1503013729 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #17828: [improvement](fetch data) Merge result into batch to reduce rpc times
github-actions[bot] commented on PR #17828: URL: https://github.com/apache/doris/pull/17828#issuecomment-1503013784 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] 924060929 commented on pull request #18548: [fix](Nerieds) Fix some bugs
924060929 commented on PR #18548: URL: https://github.com/apache/doris/pull/18548#issuecomment-1503022948 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] Gabriel39 commented on pull request #18336: [Bug](DECIMALV3) report failure if a decimal value is overflow
Gabriel39 commented on PR #18336: URL: https://github.com/apache/doris/pull/18336#issuecomment-1503026121 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] sohardforaname commented on pull request #18257: [Feature](Nereids)support udf for Nereids
sohardforaname commented on PR #18257: URL: https://github.com/apache/doris/pull/18257#issuecomment-1503026236 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] sohardforaname closed pull request #18257: [Feature](Nereids)support udf for Nereids
sohardforaname closed pull request #18257: [Feature](Nereids)support udf for Nereids URL: https://github.com/apache/doris/pull/18257 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] sohardforaname commented on pull request #18257: [Feature](Nereids)support udf for Nereids
sohardforaname commented on PR #18257: URL: https://github.com/apache/doris/pull/18257#issuecomment-1503026623 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] hello-stephen commented on pull request #18561: [Bug](materialized-view) fix match wrong index on some scan node
hello-stephen commented on PR #18561: URL: https://github.com/apache/doris/pull/18561#issuecomment-1503030291 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 34.83 seconds stream load tsv: 425 seconds loaded 74807831229 Bytes, about 167 MB/s stream load json: 23 seconds loaded 2358488459 Bytes, about 97 MB/s stream load orc: 72 seconds loaded 1101869774 Bytes, about 14 MB/s stream load parquet: 29 seconds loaded 861443392 Bytes, about 28 MB/s https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230411100054_clickbench_pr_127482.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] myfjdthink commented on issue #10452: [Feature] Doris support read iceberg table on google cloud storage
myfjdthink commented on issue #10452: URL: https://github.com/apache/doris/issues/10452#issuecomment-1503032968 Update: 我在 1.2.2 版本上继续尝试，按如下方式配置 catalog ```sql CREATE CATALOG iceberg PROPERTIES ( "type"="iceberg", "warehouse" = "gs://gcs-bucket-xxx/hive-warehouse", "iceberg.catalog.type"="hms", "hive.metastore.uris" = "thrift://10.106.199.213:9083", "AWS_ACCESS_KEY" = "xxx", "AWS_SECRET_KEY" = "xxx", "AWS_ENDPOINT" = "https://storage.googleapis.com/";, "AWS_REGION" = "us-east4", "use_path_style" = "true" ); ``` 配置后，可以访问 Hive metastore，尝试读取 Table List，一切正常 ```sql SWITCH iceberg show databases; ``` 正常 ```sql use public; show tables; ``` 正常 尝试读取 Table 里的数据，碰到问题 1. org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "gs" 添加 gcs-connector-hadoop3-latest.jar 依赖包后解决 2. Unknown file gs location for hms table 修改 fe/fe-core/src/main/java/org/apache/doris/planner/external/iceberg/IcebergScanProvider.java 里的判断逻辑，支持 GCS 可以解决 3. BE 无法识别 gs file > errCode = 2, detailMessage = failed to init reader for file gs://gcs-bucket-xxx/hive-warehouse/public.db/table/data/xxx_bucket=6/20230411_075903_15214_h7ekb-1c62bdb7-6982-412d-8114-aeb0da5a6647.orc, err: s3 uri is invalid: gs://gcs-bucket-xxx/hive-warehouse/public.db/xxx-7efe259cb5274eeabfb6d6ba803f1843/data/xxx_bucket=6/20230411_075903_15214_h7ekb-1c62bdb7-6982-412d-8114-aeb0da5a6647.orc 搜索报错关键字，找不到报错的代码位置，Block 在这里了， -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18392: [feature](function) support any type in SQL function
github-actions[bot] commented on PR #18392: URL: https://github.com/apache/doris/pull/18392#issuecomment-1503034117 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18392: [feature](function) support any type in SQL function
github-actions[bot] commented on PR #18392: URL: https://github.com/apache/doris/pull/18392#issuecomment-1503034184 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18336: [Bug](DECIMALV3) report failure if a decimal value is overflow
github-actions[bot] commented on PR #18336: URL: https://github.com/apache/doris/pull/18336#issuecomment-1503034441 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18249: [refactor](fe): Remove resource group which is useless
github-actions[bot] commented on PR #18249: URL: https://github.com/apache/doris/pull/18249#issuecomment-1503036158 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] levy5307 commented on pull request #18249: [refactor](fe): Remove resource group which is useless
levy5307 commented on PR #18249: URL: https://github.com/apache/doris/pull/18249#issuecomment-1503035516 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18404: [bug](array) fix be core in array_with_constant function when the first argument is nullable
github-actions[bot] commented on PR #18404: URL: https://github.com/apache/doris/pull/18404#issuecomment-1503038221 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] starocean999 commented on pull request #18539: [fix](nereids)the data type of compareExpr and listQuery should be the same when creating InSubquery
starocean999 commented on PR #18539: URL: https://github.com/apache/doris/pull/18539#issuecomment-1503043846 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] zclllyybb commented on pull request #18369: [Improvement](functions)Optimized some datetime function's return value
zclllyybb commented on PR #18369: URL: https://github.com/apache/doris/pull/18369#issuecomment-1503056983 run p0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] github-actions[bot] commented on pull request #18232: [chore](proto) modify the order of `store_row_column` and `is_dynamic_schema` to be compatible with branch-1.2-lts
github-actions[bot] commented on PR #18232: URL: https://github.com/apache/doris/pull/18232#issuecomment-1503083190 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [doris] yongjinhou commented on pull request #18558: [doc](https) Add https certificate docs
yongjinhou commented on PR #18558: URL: https://github.com/apache/doris/pull/18558#issuecomment-1503084534 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
