[GitHub] [incubator-doris] smallhibiscus opened a new pull request, #9044: [Refactor][doc] Add ldap, multi-tenant, sql-block-rule documentation
smallhibiscus opened a new pull request, #9044: URL: https://github.com/apache/incubator-doris/pull/9044 # Proposed changes Issue Number: close #xxx ## Problem Summary: Add ldap, multi-tenant, sql-block-rule documentation. ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] JNSimba opened a new pull request, #9043: [Refactor][Doc] Add faq and http api documentation
JNSimba opened a new pull request, #9043: URL: https://github.com/apache/incubator-doris/pull/9043 # Proposed changes Issue Number: close #xxx ## Problem Summary: Add faq and http api documentation ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] yangzhg commented on a diff in pull request #9018: [feature](optimizer): rewrite expr self compare
yangzhg commented on code in PR #9018:
URL: https://github.com/apache/incubator-doris/pull/9018#discussion_r851104994
##
fe/fe-core/src/main/java/org/apache/doris/rewrite/RewriteSelfCmpRule.java:
##
@@ -0,0 +1,57 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.rewrite;
+
+import org.apache.doris.analysis.Analyzer;
+import org.apache.doris.analysis.BinaryPredicate;
+import org.apache.doris.analysis.BoolLiteral;
+import org.apache.doris.analysis.Expr;
+import org.apache.doris.analysis.IsNullPredicate;
+import org.apache.doris.analysis.SlotRef;
+import org.apache.doris.common.AnalysisException;
+
+/**
+ * Rewrites predicate which is self compare self like A = A.
+ * =, >= , <=: where col is not null;
+ * <, >, !=: where false;
+ * <=>: where true;
+ */
+public class RewriteSelfCmpRule implements ExprRewriteRule {
+public static ExprRewriteRule INSTANCE = new RewriteSelfCmpRule();
+
+@Override
+public Expr apply(Expr expr, Analyzer analyzer, ExprRewriter.ClauseType
clauseType) throws AnalysisException {
+if (!(expr instanceof BinaryPredicate) || !(expr.getChild(0)
instanceof SlotRef)
+|| !expr.getChild(0).equals(expr.getChild(1)))
+return expr;
+
+switch (((BinaryPredicate) expr).getOp()) {
+case EQ:
+case LE:
+case GE:
+return new IsNullPredicate(expr.getChild(0), true);
+case NE:
Review Comment:
if expr is null , null != null return null not false
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman merged pull request #8996: [fix] fix p0 test failed because of char type cannot convert to datetime
morningman merged PR #8996: URL: https://github.com/apache/incubator-doris/pull/8996 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated (0bf72caf68 -> 7634e55513)
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git from 0bf72caf68 [Bug][Vectorized] Fix UB when doing ORDER BY. (#9023) add 7634e55513 [fix] fix p0 test failed because of char type cannot convert to datetime (#8996) No new revisions were added by this update. Summary of changes: .../java/org/apache/doris/catalog/PrimitiveType.java | 11 +++ .../data/correctness/test_char_implicit_cast.out | 18 ++ .../suites/correctness/test_char_implicit_cast.groovy | 13 +++-- 3 files changed, 36 insertions(+), 6 deletions(-) create mode 100644 regression-test/data/correctness/test_char_implicit_cast.out copy be/src/common/env_config.h.in => regression-test/suites/correctness/test_char_implicit_cast.groovy (60%) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman merged pull request #9002: [fix] change parameter type of hll_cardinality from STRING to HLL
morningman merged PR #9002: URL: https://github.com/apache/incubator-doris/pull/9002 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated: [fix] change parameter type of hll_cardinality from STRING to HLL (#9002)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git
The following commit(s) were added to refs/heads/master by this push:
new a2d6724fa7 [fix] change parameter type of hll_cardinality from STRING
to HLL (#9002)
a2d6724fa7 is described below
commit a2d6724fa731e348c04453d103a47d0ecdf2e73a
Author: Mingyu Chen
AuthorDate: Fri Apr 15 15:17:11 2022 +0800
[fix] change parameter type of hll_cardinality from STRING to HLL (#9002)
In #8882, we disabled the conversion from string to hll. So we need to
change the parameter type of hll_cardinality() too
---
gensrc/script/doris_builtins_functions.py| 5 +
regression-test/data/types/complex_types/basic_agg_test.out | 5 +
regression-test/suites/types/complex_types/basic_agg_test.groovy | 4 +++-
3 files changed, 9 insertions(+), 5 deletions(-)
diff --git a/gensrc/script/doris_builtins_functions.py
b/gensrc/script/doris_builtins_functions.py
index d8d027b521..6dea5780a2 100755
--- a/gensrc/script/doris_builtins_functions.py
+++ b/gensrc/script/doris_builtins_functions.py
@@ -1175,7 +1175,7 @@ visible_functions = [
'', '', 'vec', ''],
#hll function
-[['hll_cardinality'], 'BIGINT', ['VARCHAR'],
+[['hll_cardinality'], 'BIGINT', ['HLL'],
'_ZN5doris12HllFunctions15hll_cardinalityEPN9doris_udf15FunctionContextERKNS1_9StringValE',
'', '', 'vec', 'ALWAYS_NOT_NULLABLE'],
[['hll_hash'], 'HLL', ['VARCHAR'],
@@ -1184,9 +1184,6 @@ visible_functions = [
[['hll_empty'], 'HLL', [],
'_ZN5doris12HllFunctions9hll_emptyEPN9doris_udf15FunctionContextE',
'', '', 'vec', 'ALWAYS_NOT_NULLABLE'],
-[['hll_cardinality'], 'BIGINT', ['STRING'],
-
'_ZN5doris12HllFunctions15hll_cardinalityEPN9doris_udf15FunctionContextERKNS1_9StringValE',
-'', '', 'vec', 'ALWAYS_NOT_NULLABLE'],
[['hll_hash'], 'HLL', ['STRING'],
'_ZN5doris12HllFunctions8hll_hashEPN9doris_udf15FunctionContextERKNS1_9StringValE',
'', '', 'vec', 'ALWAYS_NOT_NULLABLE'],
diff --git a/regression-test/data/types/complex_types/basic_agg_test.out
b/regression-test/data/types/complex_types/basic_agg_test.out
index 057cc0032f..767a1dc038 100644
--- a/regression-test/data/types/complex_types/basic_agg_test.out
+++ b/regression-test/data/types/complex_types/basic_agg_test.out
@@ -9,3 +9,8 @@
2 \N
3 \N
+-- !sql_hll_cardinality --
+1 0
+2 1
+3 2
+
diff --git a/regression-test/suites/types/complex_types/basic_agg_test.groovy
b/regression-test/suites/types/complex_types/basic_agg_test.groovy
index c7528246e7..6314f76dab 100644
--- a/regression-test/suites/types/complex_types/basic_agg_test.groovy
+++ b/regression-test/suites/types/complex_types/basic_agg_test.groovy
@@ -27,4 +27,6 @@ suite("basic_agg_test") {
qt_sql_bitmap """select * from bitmap_basic_agg;"""
qt_sql_hll """select * from hll_basic_agg;"""
-}
\ No newline at end of file
+
+qt_sql_hll_cardinality """select k1, hll_cardinality(hll_union(k2)) from
hll_basic_agg group by k1 order by k1;"""
+}
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] jackwener commented on a diff in pull request #9018: [feature](optimizer): rewrite expr self compare
jackwener commented on code in PR #9018:
URL: https://github.com/apache/incubator-doris/pull/9018#discussion_r851107087
##
fe/fe-core/src/main/java/org/apache/doris/rewrite/RewriteSelfCmpRule.java:
##
@@ -0,0 +1,57 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.rewrite;
+
+import org.apache.doris.analysis.Analyzer;
+import org.apache.doris.analysis.BinaryPredicate;
+import org.apache.doris.analysis.BoolLiteral;
+import org.apache.doris.analysis.Expr;
+import org.apache.doris.analysis.IsNullPredicate;
+import org.apache.doris.analysis.SlotRef;
+import org.apache.doris.common.AnalysisException;
+
+/**
+ * Rewrites predicate which is self compare self like A = A.
+ * =, >= , <=: where col is not null;
+ * <, >, !=: where false;
+ * <=>: where true;
+ */
+public class RewriteSelfCmpRule implements ExprRewriteRule {
+public static ExprRewriteRule INSTANCE = new RewriteSelfCmpRule();
+
+@Override
+public Expr apply(Expr expr, Analyzer analyzer, ExprRewriter.ClauseType
clauseType) throws AnalysisException {
+if (!(expr instanceof BinaryPredicate) || !(expr.getChild(0)
instanceof SlotRef)
+|| !expr.getChild(0).equals(expr.getChild(1)))
+return expr;
+
+switch (((BinaryPredicate) expr).getOp()) {
+case EQ:
+case LE:
+case GE:
+return new IsNullPredicate(expr.getChild(0), true);
+case NE:
Review Comment:
I check `SlotRef` typle in line 39.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman merged pull request #9025: fix bug for show function
morningman merged PR #9025: URL: https://github.com/apache/incubator-doris/pull/9025 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated (a2d6724fa7 -> 67c16f3a03)
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git from a2d6724fa7 [fix] change parameter type of hll_cardinality from STRING to HLL (#9002) add 67c16f3a03 [fix](show-function) fix bug for show function (#9025) No new revisions were added by this update. Summary of changes: .../src/main/java/org/apache/doris/catalog/AggregateFunction.java | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated: [fix] Fix bug of wrong argument of drop_tablet function (#9031)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git
The following commit(s) were added to refs/heads/master by this push:
new d1d834694f [fix] Fix bug of wrong argument of drop_tablet function
(#9031)
d1d834694f is described below
commit d1d834694f73493403f8b1dc6f3e0d9b265ecbd8
Author: Luwei <814383...@qq.com>
AuthorDate: Fri Apr 15 15:19:28 2022 +0800
[fix] Fix bug of wrong argument of drop_tablet function (#9031)
introduced from #8574
---
be/src/agent/task_worker_pool.cpp | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/be/src/agent/task_worker_pool.cpp
b/be/src/agent/task_worker_pool.cpp
index 7b85d12271..23620861c2 100644
--- a/be/src/agent/task_worker_pool.cpp
+++ b/be/src/agent/task_worker_pool.cpp
@@ -421,7 +421,7 @@ void TaskWorkerPool::_drop_tablet_worker_thread_callback() {
drop_tablet_req.tablet_id, false, &err);
if (dropped_tablet != nullptr) {
Status drop_status =
StorageEngine::instance()->tablet_manager()->drop_tablet(
-drop_tablet_req.tablet_id, drop_tablet_req.schema_hash);
+drop_tablet_req.tablet_id);
if (!drop_status.ok()) {
LOG(WARNING) << "drop table failed! signature: " <<
agent_task_req.signature;
error_msgs.push_back("drop table failed!");
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman merged pull request #9031: [Bug] Fix bug of wrong argument of drop_tablet function
morningman merged PR #9031: URL: https://github.com/apache/incubator-doris/pull/9031 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] luzhijing commented on pull request #9038: [fix][doc]fix max_send_batch_parallelism_per_job default value
luzhijing commented on PR #9038: URL: https://github.com/apache/incubator-doris/pull/9038#issuecomment-1099930964 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] caoliang-web opened a new pull request, #9045: [Refactor][doc] Write documents related to cluster management and external data import
caoliang-web opened a new pull request, #9045: URL: https://github.com/apache/incubator-doris/pull/9045 ## Problem Summary: 1.Sort out cluster management related documents 2.Sort out external data import documents ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9038: [fix][doc]fix max_send_batch_parallelism_per_job default value
github-actions[bot] commented on PR #9038: URL: https://github.com/apache/incubator-doris/pull/9038#issuecomment-1099936707 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9038: [fix][doc]fix max_send_batch_parallelism_per_job default value
github-actions[bot] commented on PR #9038: URL: https://github.com/apache/incubator-doris/pull/9038#issuecomment-1099936680 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9044: [Refactor][doc] Add ldap, multi-tenant, sql-block-rule documentation
github-actions[bot] commented on PR #9044: URL: https://github.com/apache/incubator-doris/pull/9044#issuecomment-1099937653 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9044: [Refactor][doc] Add ldap, multi-tenant, sql-block-rule documentation
github-actions[bot] commented on PR #9044: URL: https://github.com/apache/incubator-doris/pull/9044#issuecomment-1099937667 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9045: [Refactor][doc] Write documents related to cluster management and external data import
github-actions[bot] commented on PR #9045: URL: https://github.com/apache/incubator-doris/pull/9045#issuecomment-1099938461 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9045: [Refactor][doc] Write documents related to cluster management and external data import
github-actions[bot] commented on PR #9045: URL: https://github.com/apache/incubator-doris/pull/9045#issuecomment-1099938480 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9043: [Refactor][Doc] Add faq and http api documentation
github-actions[bot] commented on PR #9043: URL: https://github.com/apache/incubator-doris/pull/9043#issuecomment-1099940184 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9043: [Refactor][Doc] Add faq and http api documentation
github-actions[bot] commented on PR #9043: URL: https://github.com/apache/incubator-doris/pull/9043#issuecomment-1099940199 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 commented on a diff in pull request #8867: [Refactor][Doc]Add part of the document content for Get-Starting
hf200012 commented on code in PR #8867:
URL: https://github.com/apache/incubator-doris/pull/8867#discussion_r844549982
##
new-docs/zh-CN/get-starting/get-starting.md:
##
@@ -1,11 +1,12 @@
---
{
-"title": "快速开始",
+"title": "Get-Starting",
Review Comment:
The name of the Chinese document here is to use Chinese
##
new-docs/zh-CN/get-starting/get-starting.md:
##
@@ -24,4 +25,665 @@ specific language governing permissions and limitations
under the License.
-->
-# 快速开始
\ No newline at end of file
+# Apache Doris 快速入门
+
+本文适用于暂未学习Apache Doris、想极速体验完整Apache Doris从编译部署到具体应用的同学。
+
+本文适用于多平台（Win|Mac|Linux）、多方式（裸机|Docker|虚拟机）的**单机部署**，可根据客观情况选择。
+
+## 环境准备
+
+1. CPU：2C（最低）8C（推荐）
+2. 内存：4G（最低）48G（推荐）
+3. 硬盘：100G（最低）400G（推荐）
+4. 平台：MacOS（Inter）、LinuxOS、Windows虚拟机
+5. 系统：CentOS（7.1及以上）、Ubuntu（16.04 及以上）
+6. 软件：JDK（1.8及以上）、GCC（4.8.2 及以上）
+
+## 单机部署
+
+**在创建之前，请准备好已完成编译的FE/BE文件，此教程不再赘述编译过程。**
+
+> 如无编译意向或想直接下载编译成功的文件，可使用如下链接下载对应版本
+>
+> Apache-Doris-Release--JDK1.8 预编译版本：
+>
+> 百度Palo-1.0-preview2-JDK1.8
预编译版本：https://palo-cloud-repo-bd.bd.bcebos.com/baidu-doris-release/PALO-1.0.0-preview2-no-avx2-binary.tar.gz
+
+1. 设置系统最大打开文件句柄数
+
+ ```shell
+ vi /etc/security/limits.conf
+ # 添加以下两行信息
+ * soft nofile 65536
+ * hard nofile 65536
+ # 保存退出并重启服务器
+ ```
+
+2. 下载二进制包/自主编译 FE / BE 文件
+
+ ```shell
+ wget https://doris.apache.org/apache-doris-release/要部署的版本
+ wget https://palo-cloud-repo-bd.bd.bcebos.com/baidu-doris-release/要部署的版本
+ # 例如如下链接
+ wget https://doris.apache.org/release/doris-1.0.0.tar.gz
+ wget
https://palo-cloud-repo-bd.bd.bcebos.com/baidu-doris-release/PALO-1.0.0-preview2-no-avx2-binary.tar.gz
+ ```
+
+3. 解压缩 tar.gz 文件
+
+ ```shell
+ tar -zxvf 下载好的二进制压缩包
+ # 例如
+ tar -zxvf PALO-1.0.0-preview2-no-avx2-binary.tar.gz
+ ```
+
+4. 迁移解压缩后的程序文件至指定目录并重命名
+
+ ```shell
+ mv 解压后的根目录 目标路径
+ cd 目标路径
+ # 例如
+ mv PALO-1.0.0-preview2-no-avx2-binary /opt/doris
+ cd /opt/doris
+ ```
+
+5. 配置 FE
+
+ ```shell
+ # 配置FE-Config
+ vi fe/conf/fe.conf
+ # 取消priority_networks的注释，修改参数
+ priority_networks = 127.0.0.0/24
+ # 保存退出
+ ```
+
+6. 配置 BE
+
+ ```shell
+ # 配置FE-Config
+ vi be/conf/be.conf
+ # 取消priority_networks的注释，修改参数
+ priority_networks = 127.0.0.0/24
+ # 保存退出
+ ```
+
+7. 配置环境变量
+
+ ```shell
+ # 配置环境变量
+ vim /etc/profile.d/doris.sh
+ export DORIS_HOME=Doris根目录 # 例如/opt/doris
+ export PATH=$PATH:$DORIS_HOME/fe/bin:$DORIS_HOME/be/bin
+ # 保存并source
+ source /etc/profile.d/doris.sh
+ ```
+
+8. 启动 FE 和 BE 并注册 BE 至 FE
+
+ ```shell
+ start_fe.sh --daemon
+ start_be.sh --daemon
+ ```
+
+ 校验FE启动是否成功
+
+ > 1. 检查是否启动成功, JPS 命令下有没有 PaloFe 进程
+ > 2. FE 进程启动后，会⾸先加载元数据，根据 FE ⻆⾊的不同，在⽇志中会看到 transfer from UNKNOWN to
MASTER/FOLLOWER/OBSERVER 。最终会看到 thrift server started ⽇志，并且可以通过 mysql 客户端连接到
FE，则 表示 FE 启动成功。
+ > 3. 也可以通过如下连接查看是否启动成功： http://fe_host:fe_http_port/api/bootstrap 如果返回：
{"status":"OK","msg":"Success"} 则表示启动成功，其余情况，则可能存在问题。
+ > 4. 外⽹环境访问 http://fe_host:fe_http_port 查看是否可以访问WebUI界 ⾯，登录账号默认为root，密码为空
+ >
+ > **注：如果在 fe.log 中查看不到启动失败的信息，也许在 fe.out 中可以看到。**
+
+ 校验 BE 启动是否成功
+
+ > 1. BE 进程启动后，如果之前有数据，则可能有数分钟不等的数据索引加载时 间。
+ > 2. 如果是 BE 的第⼀次启动，或者该 BE 尚未加⼊任何集群，则 BE ⽇志会定期滚 动 waiting to receive first
heartbeat from frontend 字样。表示 BE 还未通过 FE 的⼼跳收到 Master 的地址，正在被动等待。这种错误⽇志， 在 FE 中
ADD BACKEND 并发送⼼跳后，就会消失。如果在接到⼼跳后，⼜重 复出现 master client, get client from cache
failed.host: , port: 0, code: 7 字样，说明 FE 成功连接了 BE，但 BE ⽆法主动连接 FE。可能需要检查 BE 到 FE
的 rpc_port 的连通性。
+ > 3. 如果 BE 已经被加⼊集群，⽇志中应该每隔 5 秒滚动来⾃ FE 的⼼跳⽇ 志： get heartbeat, host:
xx.xx.xx.xx, port: 9020, cluster id: xx ，表示⼼跳正常。
+ > 4. 其次，⽇志中应该每隔 10 秒滚动 finish report task success. return code: 0 的字样，表示 BE
向 FE 的通信正常。
+ > 5. 同时，如果有数据查询，应该能看到不停滚动的⽇志，并且有 execute time is xxx ⽇志，表示 BE 启动成功，并且查询正常。
+ > 6. 也可以通过如下连接查看是否启动成功： http://be_host:be_http_port/api/health 如果返回：
{"status": "OK","msg": "To Be Added"} 则表示启动成功，其余情况，则可能存在问题。
+ >
+ > **注：如果在 be.INFO 中查看不到启动失败的信息，也许在 be.out 中可以看到。**
+
+ 注册 BE 至 FE（使用MySQL-Client，需自行安装）
+
+ ```shell
+ # 登录
+ mysql -h 127.0.0.1 -P 9030 -uroot
+ # 注册BE
+ ALTER SYSTEM ADD BACKEND "127.0.0.1:9050";
+ ```
+
+## Apache Doris简单使用
+
+Doris 采用 MySQL 协议进行通信，用户可通过 MySQL Client 或者 MySQL JDBC 连接到 Doris 集群。选择 MySQL
client 版本时建议采用5.1 之后的版本，因为 5.1 之前不能支持长度超过 16 个字符的用户名。Doris SQL 语法基本覆盖 MySQL 语法。
+
+### Apache Doris Web UI访问
+
+默认使用 Http 协议进行 WebUI 访问，在浏览器输入以下格式地址访问
+
+```cql
+http://FE_IP:FE_HTTP_PORT(默认8030)
+```
+
Review Comment:
It is best to put a screenshot here, use lossless compression, and control
the picture to dozens of kb
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8867: [Refactor][Doc]Add part of the document content for Get-Starting
github-actions[bot] commented on PR #8867: URL: https://github.com/apache/incubator-doris/pull/8867#issuecomment-1099951698 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8867: [Refactor][Doc]Add part of the document content for Get-Starting
github-actions[bot] commented on PR #8867: URL: https://github.com/apache/incubator-doris/pull/8867#issuecomment-1099951663 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #9044: [Refactor][doc] Add ldap, multi-tenant, sql-block-rule documentation
hf200012 merged PR #9044: URL: https://github.com/apache/incubator-doris/pull/9044 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated: Add ldap, multi-tenant, sql-block-rule documentation (#9044)
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 415695f84e Add ldap, multi-tenant, sql-block-rule documentation (#9044) 415695f84e is described below commit 415695f84ed22a20b92f7db57cd1fc56b68b4742 Author: smallhibiscus <844981...@qq.com> AuthorDate: Fri Apr 15 16:30:56 2022 +0800 Add ldap, multi-tenant, sql-block-rule documentation (#9044) Add ldap, multi-tenant, sql-block-rule documentation --- new-docs/.vuepress/sidebar/en.js | 4 + new-docs/.vuepress/sidebar/zh-CN.js| 4 + new-docs/en/admin-manual/ldap.md | 18 +- new-docs/en/admin-manual/multi-tenant.md | 28 +-- .../Alter/ALTER-SQL-BLOCK-RULE.md | 69 .../Create/CREATE-SQL-BLOCK-RULE.md| 101 +++ .../Drop/DROP-SQL-BLOCK-RULE.md} | 37 +++- .../Show-Statements/SHOW-SQL-BLOCK-RULE.md | 76 new-docs/zh-CN/admin-manual/ldap.md| 167 +- new-docs/zh-CN/admin-manual/multi-tenant.md| 195 - .../Alter/ALTER-SQL-BLOCK-RULE.md | 69 .../Create/CREATE-SQL-BLOCK-RULE.md| 101 +++ .../Drop/DROP-SQL-BLOCK-RULE.md} | 36 +++- .../Show-Statements/SHOW-EXPORT.md | 2 + .../Show-Statements/SHOW-SQL-BLOCK-RULE.md | 77 15 files changed, 954 insertions(+), 30 deletions(-) diff --git a/new-docs/.vuepress/sidebar/en.js b/new-docs/.vuepress/sidebar/en.js index 3e047a25fa..5168c3c7e9 100644 --- a/new-docs/.vuepress/sidebar/en.js +++ b/new-docs/.vuepress/sidebar/en.js @@ -528,6 +528,7 @@ module.exports = [ initialOpenGroupIndex: -1, children: [ "ALTER-DATABASE", + "ALTER-SQL-BLOCK-RULE", "ALTER-TABLE-COLUMN", "ALTER-TABLE-PARTITION", "ALTER-TABLE-PROPERTY", @@ -563,6 +564,7 @@ module.exports = [ "CREATE-INDEX", "CREATE-MATERIALIZED-VIEW", "CREATE-RESOURCE", + "CREATE-SQL-BLOCK-RULE", "CREATE-TABLE-LIKE", "CREATE-TABLE", "CREATE-VIEW", @@ -581,6 +583,7 @@ module.exports = [ "DROP-INDEX", "DROP-MATERIALIZED-VIEW", "DROP-RESOURCE", + "DROP-SQL-BLOCK-RULE", "DROP-TABLE", "TRUNCATE-TABLE", ], @@ -696,6 +699,7 @@ module.exports = [ "SHOW-ROUTINE-LOAD", "SHOW-SMALL-FILES", "SHOW-SNAPSHOT", + "SHOW-SQL-BLOCK-RULE", "SHOW-STATUS", "SHOW-STREAM-LOAD", "SHOW-TABLE-ID", diff --git a/new-docs/.vuepress/sidebar/zh-CN.js b/new-docs/.vuepress/sidebar/zh-CN.js index b25812c9bd..844515615a 100644 --- a/new-docs/.vuepress/sidebar/zh-CN.js +++ b/new-docs/.vuepress/sidebar/zh-CN.js @@ -528,6 +528,7 @@ module.exports = [ initialOpenGroupIndex: -1, children: [ "ALTER-DATABASE", + "ALTER-SQL-BLOCK-RULE", "ALTER-TABLE-COLUMN", "ALTER-TABLE-PARTITION", "ALTER-TABLE-PROPERTY", @@ -563,6 +564,7 @@ module.exports = [ "CREATE-INDEX", "CREATE-MATERIALIZED-VIEW", "CREATE-RESOURCE", + "CREATE-SQL-BLOCK-RULE", "CREATE-TABLE-LIKE", "CREATE-TABLE", "CREATE-VIEW", @@ -581,6 +583,7 @@ module.exports = [ "DROP-INDEX", "DROP-MATERIALIZED-VIEW", "DROP-RESOURCE", + "DROP-SQL-BLOCK-RULE", "DROP-TABLE", "TRUNCATE-TABLE", ], @@ -696,6 +699,7 @@ module.exports = [ "SHOW-ROUTINE-LOAD", "SHOW-SMALL-FILES", "SHOW-SNAPSHOT", + "SHOW-SQL-BLOCK-RULE", "SHOW-STATUS", "SHOW-STREAM-LOAD", "SHOW-TABLE-ID", diff --git a/new-docs/en/admin-manual/ldap.md b/new-docs/en/admin-manual/ldap.md index cb3cb25b99..01a139fb25 100644 --- a/new-docs/en/admin-manual/ldap.md +++ b/new-docs/en/admin-manual/ldap.md @@ -73,7 +73,7 @@ You need to configure the LDAP basic information in the fe/conf/ldap.conf file, Set the LDAP administrator password: After configuring the ldap.conf file, start fe, log in to Doris with the root or admin account, and execute sql: -``` +```sql set ldap_admin_password = 'ldap_admin_password'; ```
[GitHub] [incubator-doris] hf200012 merged pull request #9045: [Refactor][doc] Write documents related to cluster management and external data import
hf200012 merged PR #9045: URL: https://github.com/apache/incubator-doris/pull/9045 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated: [Refactor][doc] Write documents related to cluster management and external data import (#9045)
This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git
The following commit(s) were added to refs/heads/master by this push:
new 35a425e136 [Refactor][doc] Write documents related to cluster
management and external data import (#9045)
35a425e136 is described below
commit 35a425e136ad7ba161ffc988b8885b10467f7fcc
Author: caoliang-web <71004656+caoliang-...@users.noreply.github.com>
AuthorDate: Fri Apr 15 16:31:25 2022 +0800
[Refactor][doc] Write documents related to cluster management and external
data import (#9045)
* Write documents related to cluster management and external data import
---
new-docs/.vuepress/sidebar/en.js | 11 +-
new-docs/.vuepress/sidebar/zh-CN.js| 11 +-
new-docs/en/admin-manual/cluster-admin/doris-ha.md | 26 -
.../cluster-management/elastic-expansion.md| 149 +
.../cluster-management/load-balancing.md | 636 +
.../{ => cluster-management}/upgrade.md| 0
new-docs/en/admin-manual/elastic-expansion.md | 28 -
new-docs/en/admin-manual/sql-interception.md | 94 +++
.../import/import-scenes/external-storage-load.md | 155 -
.../zh-CN/admin-manual/cluster-admin/doris-ha.md | 26 -
.../cluster-management/elastic-expansion.md| 141 +
.../cluster-management/load-balancing.md | 635
.../admin-manual/cluster-management/upgrade.md | 84 +++
new-docs/zh-CN/admin-manual/elastic-expansion.md | 26 -
new-docs/zh-CN/admin-manual/sql-interception.md| 93 +++
new-docs/zh-CN/admin-manual/upgrade.md | 27 -
.../import/import-scenes/external-storage-load.md | 157 -
17 files changed, 2152 insertions(+), 147 deletions(-)
diff --git a/new-docs/.vuepress/sidebar/en.js b/new-docs/.vuepress/sidebar/en.js
index 5168c3c7e9..b7ce458b43 100644
--- a/new-docs/.vuepress/sidebar/en.js
+++ b/new-docs/.vuepress/sidebar/en.js
@@ -755,14 +755,14 @@ module.exports = [
directoryPath: "admin-manual/",
initialOpenGroupIndex: -1,
children: [
- "upgrade",
- "elastic-expansion",
{
-title: "High availability",
-directoryPath: "cluster-admin/",
+title: "cluster management",
+directoryPath: "cluster-management/",
initialOpenGroupIndex: -1,
children: [
- "doris-ha"
+ "upgrade",
+ "elastic-expansion",
+ "load-balancing"
],
},
{
@@ -775,6 +775,7 @@ module.exports = [
"delete-recover"
],
},
+ "sql-interception",
"query-profile",
"optimization",
{
diff --git a/new-docs/.vuepress/sidebar/zh-CN.js
b/new-docs/.vuepress/sidebar/zh-CN.js
index 844515615a..b349591c9a 100644
--- a/new-docs/.vuepress/sidebar/zh-CN.js
+++ b/new-docs/.vuepress/sidebar/zh-CN.js
@@ -755,14 +755,14 @@ module.exports = [
directoryPath: "admin-manual/",
initialOpenGroupIndex: -1,
children: [
- "upgrade",
- "elastic-expansion",
{
-title: "集群高可用",
-directoryPath: "cluster-admin/",
+title: "集群管理",
+directoryPath: "cluster-management/",
initialOpenGroupIndex: -1,
children: [
- "doris-ha"
+ "upgrade",
+ "elastic-expansion",
+ "load-balancing"
],
},
{
@@ -775,6 +775,7 @@ module.exports = [
"delete-recover"
],
},
+ "sql-interception",
"query-profile",
"optimization",
{
diff --git a/new-docs/en/admin-manual/cluster-admin/doris-ha.md
b/new-docs/en/admin-manual/cluster-admin/doris-ha.md
deleted file mode 100644
index ff85f5bac2..00
--- a/new-docs/en/admin-manual/cluster-admin/doris-ha.md
+++ /dev/null
@@ -1,26 +0,0 @@
-{
-"title": "Doris High Availability",
-"language": "en"
-}
-
-
-
diff --git a/new-docs/en/admin-manual/cluster-management/elastic-expansion.md
b/new-docs/en/admin-manual/cluster-management/elastic-expansion.md
new file mode 100644
index 00..fc3d69595e
--- /dev/null
+++ b/new-docs/en/admin-manual/cluster-management/elastic-expansion.md
@@ -0,0 +1,149 @@
+---
+{
+"title": "Elastic scaling",
+"language": "en"
+}
+
+---
+
+
+
+# Elastic scaling
+
+Doris can easily expand and shrink FE, BE, Broker instances.
+
+## FE Expansion and Compression
+
+High availability of FE can be achieved by expanding FE to three top-one nodes.
+
+Users can login to Master FE through MySQL client. By:
+
+`SHOW PROC '/frontends';`
+
+To view the current FE node situation.
+
+You can also view the FE node through the front-end page connection:
``http://fe_hostname:fe_http_port/frontend`` or
```http://fe_hostname:fe_http_port/system?Path=//frontends```.
+
+All of the above methods require Doris's root user rights.
+
+The pr
[GitHub] [incubator-doris] hf200012 merged pull request #9043: [Refactor][Doc] Add faq and http api documentation
hf200012 merged PR #9043: URL: https://github.com/apache/incubator-doris/pull/9043 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #9030: [Refactor][doc] Modify create and drop docs in DDL module.
hf200012 merged PR #9030: URL: https://github.com/apache/incubator-doris/pull/9030 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated (b895f7a38b -> df021dc7eb)
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git from b895f7a38b add faq doc and http api (#9043) add df021dc7eb Modify create and drop docs in DDL module. (#9030) No new revisions were added by this update. Summary of changes: .../Backup-and-Restore/RECOVER.md | 21 ++- .../Create/CREATE-DATABASE.md | 52 +- .../Create/CREATE-ENCRYPT-KEY.md | 51 +- .../Create/CREATE-EXTERNAL-TABLE.md| 193 + .../Create/CREATE-FILE.md | 63 ++- .../Create/CREATE-FUNCTION.md | 118 - .../Create/CREATE-INDEX.md | 25 ++- .../Create/CREATE-MATERIALIZED-VIEW.md | 190 +++- .../Create/CREATE-RESOURCE.md | 110 +++- .../Create/CREATE-TABLE-LIKE.md| 61 +++ .../Create/CREATE-TABLE.md | 67 --- .../Create/CREATE-VIEW.md | 46 - .../Drop/DROP-DATABASE.md | 25 ++- .../Drop/DROP-ENCRYPT-KEY.md | 27 ++- .../Data-Definition-Statements/Drop/DROP-FILE.md | 29 +++- .../Drop/DROP-FUNCTION.md | 27 ++- .../Data-Definition-Statements/Drop/DROP-INDEX.md | 20 ++- .../Drop/DROP-MATERIALIZED-VIEW.md | 83 - .../Drop/DROP-RESOURCE.md | 22 ++- .../Data-Definition-Statements/Drop/DROP-TABLE.md | 32 +++- .../Drop/TRUNCATE-TABLE.md | 34 +++- .../Backup-and-Restore/RECOVER.md | 23 ++- .../Create/CREATE-DATABASE.md | 52 +- .../Create/CREATE-ENCRYPT-KEY.md | 52 +- .../Create/CREATE-EXTERNAL-TABLE.md| 191 .../Create/CREATE-FILE.md | 63 ++- .../Create/CREATE-FUNCTION.md | 117 + .../Create/CREATE-INDEX.md | 25 ++- .../Create/CREATE-MATERIALIZED-VIEW.md | 189 .../Create/CREATE-RESOURCE.md | 109 .../Create/CREATE-TABLE-LIKE.md| 61 +++ .../Create/CREATE-TABLE.md | 30 ++-- .../Create/CREATE-VIEW.md | 45 + .../Drop/DROP-DATABASE.md | 23 +++ .../Drop/DROP-ENCRYPT-KEY.md | 26 ++- .../Data-Definition-Statements/Drop/DROP-FILE.md | 26 +++ .../Drop/DROP-FUNCTION.md | 24 +++ .../Data-Definition-Statements/Drop/DROP-INDEX.md | 17 ++ .../Drop/DROP-MATERIALIZED-VIEW.md | 82 + .../Drop/DROP-RESOURCE.md | 19 ++ .../Data-Definition-Statements/Drop/DROP-TABLE.md | 30 .../Drop/TRUNCATE-TABLE.md | 31 42 files changed, 2438 insertions(+), 93 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #9029: [Refactor][Doc] Added doc for the operation and maintenance monitoring section
hf200012 merged PR #9029: URL: https://github.com/apache/incubator-doris/pull/9029 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #9022: [Refactor][Doc] Add advance replace table and update directory
hf200012 merged PR #9022: URL: https://github.com/apache/incubator-doris/pull/9022 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated (dbb340c330 -> 0dab974e91)
This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git
from dbb340c330 add doc for ops monitor (#9029)
add 0dab974e91 add advance replace table (#9022)
No new revisions were added by this update.
Summary of changes:
new-docs/.vuepress/sidebar/en.js | 10 +-
new-docs/.vuepress/sidebar/zh-CN.js | 12 ++--
.../en/advanced/alter-table/replace-table.md | 2 +-
new-docs/en/advanced/{ => alter-table}/schema-change.md | 0
.../zh-CN/advanced/alter-table/replace-table.md | 12 +---
new-docs/zh-CN/advanced/{ => alter-table}/schema-change.md | 0
6 files changed, 25 insertions(+), 11 deletions(-)
copy docs/en/administrator-guide/alter-table/alter-table-replace-table.md =>
new-docs/en/advanced/alter-table/replace-table.md (98%)
rename new-docs/en/advanced/{ => alter-table}/schema-change.md (100%)
copy docs/zh-CN/administrator-guide/alter-table/alter-table-replace-table.md
=> new-docs/zh-CN/advanced/alter-table/replace-table.md (77%)
rename new-docs/zh-CN/advanced/{ => alter-table}/schema-change.md (100%)
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated (0dab974e91 -> f86a29066a)
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git from 0dab974e91 add advance replace table (#9022) add f86a29066a Modify Account Management SQL Help Document (#9020) No new revisions were added by this update. Summary of changes: .../Account-Management-Statements/CREATE-ROLE.md | 4 .../Account-Management-Statements/CREATE-USER.md | 4 .../Account-Management-Statements/DROP-ROLE.md | 14 ++ .../Account-Management-Statements/DROP-USER.md | 4 .../Account-Management-Statements/GRANT.md | 4 .../Account-Management-Statements/LDAP.md | 4 .../Account-Management-Statements/REVOKE.md| 4 .../Account-Management-Statements/SET-PASSWORD.md | 4 .../Account-Management-Statements/SET-PROPERTY.md | 4 .../Account-Management-Statements/CREATE-ROLE.md | 4 .../Account-Management-Statements/CREATE-USER.md | 4 .../Account-Management-Statements/DROP-ROLE.md | 10 +++--- .../Account-Management-Statements/DROP-USER.md | 4 .../Account-Management-Statements/GRANT.md | 4 .../Account-Management-Statements/LDAP.md | 4 .../Account-Management-Statements/REVOKE.md| 4 .../Account-Management-Statements/SET-PASSWORD.md | 4 .../Account-Management-Statements/SET-PROPERTY.md | 22 +- 18 files changed, 94 insertions(+), 12 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #9020: [fix][doc]Modify Account Management SQL Help Document
hf200012 merged PR #9020: URL: https://github.com/apache/incubator-doris/pull/9020 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9036: [Refactor][doc]Add show proc,show trash
github-actions[bot] commented on PR #9036: URL: https://github.com/apache/incubator-doris/pull/9036#issuecomment-1099965946 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9036: [Refactor][doc]Add show proc,show trash
github-actions[bot] commented on PR #9036: URL: https://github.com/apache/incubator-doris/pull/9036#issuecomment-1099965924 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #8926: [Refactor][doc]Edit the ecological extension part of the document
hf200012 merged PR #8926: URL: https://github.com/apache/incubator-doris/pull/8926 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #9036: [Refactor][doc]Add show proc,show trash
hf200012 merged PR #9036: URL: https://github.com/apache/incubator-doris/pull/9036 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated: Add show proc,show trash (#9036)
This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git
The following commit(s) were added to refs/heads/master by this push:
new 6fba6a58ea Add show proc,show trash (#9036)
6fba6a58ea is described below
commit 6fba6a58eab46668d26e2927c0a0ccfa65decc36
Author: jiafeng.zhang
AuthorDate: Fri Apr 15 16:37:51 2022 +0800
Add show proc,show trash (#9036)
Add show proc,show trash
---
new-docs/.vuepress/sidebar/en.js | 1 +
new-docs/.vuepress/sidebar/zh-CN.js| 1 +
.../sql-reference-v2/Show-Statements/SHOW-PROC.md | 178
.../sql-reference-v2/Show-Statements/SHOW-TRASH.md | 66
.../sql-reference-v2/Show-Statements/SHOW-PROC.md | 180 -
.../{SHOW-PROC.md => SHOW-TRASH.md}| 36 -
6 files changed, 458 insertions(+), 4 deletions(-)
diff --git a/new-docs/.vuepress/sidebar/en.js b/new-docs/.vuepress/sidebar/en.js
index c03a23f00d..994b53c1c0 100644
--- a/new-docs/.vuepress/sidebar/en.js
+++ b/new-docs/.vuepress/sidebar/en.js
@@ -789,6 +789,7 @@ module.exports = [
"SHOW-TABLET",
"SHOW-TRANSACTION",
"SHOW-TRIGGERS",
+ "SHOW-TRASH",
"SHOW-USER",
"SHOW-VARIABLES",
"SHOW-VIEW",
diff --git a/new-docs/.vuepress/sidebar/zh-CN.js
b/new-docs/.vuepress/sidebar/zh-CN.js
index dbb16a83a5..df126fa297 100644
--- a/new-docs/.vuepress/sidebar/zh-CN.js
+++ b/new-docs/.vuepress/sidebar/zh-CN.js
@@ -789,6 +789,7 @@ module.exports = [
"SHOW-TABLET",
"SHOW-TRANSACTION",
"SHOW-TRIGGERS",
+ "SHOW-TRASH",
"SHOW-USER",
"SHOW-VARIABLES",
"SHOW-VIEW",
diff --git
a/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-PROC.md
b/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-PROC.md
index 1e85c7b3e0..381515669f 100644
--- a/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-PROC.md
+++ b/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-PROC.md
@@ -26,10 +26,188 @@ under the License.
## SHOW-PROC
+### Name
+
+SHOW PROC
+
### Description
+The Proc system is a unique feature of Doris. Students who have used Linux may
understand this concept better. In Linux systems, proc is a virtual file
system, usually mounted in the /proc directory. Users can view the internal
data structure of the system through this file system. For example, you can
view the details of the specified pid process through /proc/pid.
+
+Similar to the proc system in Linux, the proc system in Doris is also
organized into a directory-like structure to view different system information
according to the "directory path (proc path)" specified by the user.
+
+The proc system is designed mainly for system administrators, so that it is
convenient for them to view some running states inside the system. Such as the
tablet status of the table, the cluster balance status, the status of various
jobs, and so on. is a very useful function
+
+There are two ways to view the proc system in Doris.
+
+1. View through the WEB UI interface provided by Doris, visit the address:
`http://FE_IP:FE_HTTP_PORT`
+2. Another way is by command
+
+All commands supported by Doris PROC can be seen through ` SHOW PROC "/";`
+
+After connecting to Doris through the MySQL client, you can execute the SHOW
PROC statement to view the information of the specified proc directory. The
proc directory is an absolute path starting with "/".
+
+The results of the show proc statement are presented in a two-dimensional
table. And usually the first column of the result table is the next
subdirectory of proc.
+
+none
+mysql> show proc "/";
++---+
+| name |
++---+
+| statistic |
+| brokers |
+| frontends |
+| routine_loads |
+| auth |
+| jobs |
+| bdbje |
+| resources |
+| monitor |
+| transactions |
+| colocation_group |
+| backends |
+| trash |
+| cluster_balance |
+| current_queries |
+| dbs |
+| load_error_hub|
+| current_backend_instances |
+| tasks |
++---+
+19 rows in set (0.00 sec)
+
+
+illustrate:
+
+1. Statistics: It is mainly used to summarize and view the number of
databases, tables, partitions, shards, and replicas in the Doris cluster. and
the number of unhealthy copies. This information helps us to control the size
of the cluster meta-information in general. It helps us view the cluster
sharding situation
[GitHub] [incubator-doris] hf200012 merged pull request #8867: [Refactor][Doc]Add part of the document content for Get-Starting
hf200012 merged PR #8867: URL: https://github.com/apache/incubator-doris/pull/8867 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated: [Refactor][Doc]Add part of the document content for Get-Starting (#8867)
This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git
The following commit(s) were added to refs/heads/master by this push:
new 556602a5f1 [Refactor][Doc]Add part of the document content for
Get-Starting (#8867)
556602a5f1 is described below
commit 556602a5f11a765d0d4002e6d565edb05bdfee65
Author: FreeOnePlus <54164178+freeonep...@users.noreply.github.com>
AuthorDate: Fri Apr 15 16:38:42 2022 +0800
[Refactor][Doc]Add part of the document content for Get-Starting (#8867)
* Add part of the document content for Get-Starting
---
new-docs/en/get-starting/get-starting.md| 670 +++-
new-docs/zh-CN/get-starting/get-starting.md | 668 ++-
2 files changed, 1332 insertions(+), 6 deletions(-)
diff --git a/new-docs/en/get-starting/get-starting.md
b/new-docs/en/get-starting/get-starting.md
index 19ddd0b111..c64624f992 100644
--- a/new-docs/en/get-starting/get-starting.md
+++ b/new-docs/en/get-starting/get-starting.md
@@ -1,11 +1,12 @@
---
{
-"title": "Getting Started",
+"title": "Get-Starting",
"language": "en"
}
+
---
-
\ No newline at end of file
+-->
+
+# Apache Doris Get-Starting
+
+This article is suitable for students who have not learned Apache Doris yet
and want to quickly experience the complete Apache Doris from compilation and
deployment to specific applications.
+
+This article is applicable to multi-platform (Win|Mac|Linux) and multi-mode
(bare metal|Docker|virtual machine) **single-machine deployment**, which can be
selected according to the objective situation.
+
+## Environmental preparation
+
+1. CPU: 2C (minimum) 8C (recommended)
+2. Memory: 4G (minimum) 48G (recommended)
+3. Hard disk: 100G (minimum) 400G (recommended)
+4. Platform: MacOS (Inter), LinuxOS, Windows virtual machine
+5. System: CentOS (7.1 and above), Ubuntu (16.04 and above)
+6. Software: JDK (1.8 and above), GCC (4.8.2 and above)
+
+## Stand-alone deployment
+
+**Before creating, please prepare the compiled FE/BE file, this tutorial will
not repeat the compilation process. **
+
+> If you have no intention of compiling or want to directly download the
successfully compiled file, you can use the following link to download the
corresponding version
+>
+> Apache-Doris-Release--JDK1.8 precompiled version:
+>
+> Baidu Palo-1.0-preview2-JDK1.8 precompiled version:
https://palo-cloud-repo-bd.bd.bcebos.com/baidu-doris-release/PALO-1.0.0-preview2-no-avx2
-binary.tar.gz
+
+1. Set the maximum number of open file handles in the system
+
+ ```shell
+ vi /etc/security/limits.conf
+ # Add the following two lines of information
+ * soft nofile 65536
+ * hard nofile 65536
+ # Save and exit and restart the server
+ ```
+
+2. Download binary package / self-compile FE / BE files
+
+ ```shell
+ wget https://doris.apache.org/apache-doris-release/version to deploy
+ wget https://palo-cloud-repo-bd.bd.bcebos.com/baidu-doris-release/version
to deploy
+ # For example the following link
+ wget https://doris.apache.org/release/doris-1.0.0.tar.gz
+ wget
https://palo-cloud-repo-bd.bd.bcebos.com/baidu-doris-release/PALO-1.0.0-preview2-no-avx2-binary.tar.gz
+ ```
+
+3. Extract the tar.gz file
+
+ ```shell
+ tar -zxvf Downloaded binary archive
+ # example
+ tar -zxvf PALO-1.0.0-preview2-no-avx2-binary.tar.gz
+ ```
+
+4. Migrate the decompressed program files to the specified directory and
rename them
+
+ ```shell
+ mv [unzipped root directory] [Target path]
+ cd [Target path]
+ # example
+ mv PALO-1.0.0-preview2-no-avx2-binary /opt/doris
+ cd /opt/doris
+ ```
+
+5. Configure FE
+
+ ```shell
+ # Configure FE-Config
+ vi fe/conf/fe.conf
+ # Uncomment priority_networks and modify parameters
+ priority_networks = 127.0.0.0/24
+ # save and exit
+ ```
+
+6. Configure BE
+
+ ```shell
+ # Configure BE-Config
+ vi be/conf/be.conf
+ # Uncomment priority_networks and modify parameters
+ priority_networks = 127.0.0.0/24
+ # save and exit
+ ```
+
+7. Configure environment variables
+
+ ```shell
+ # Configure environment variables
+ vim /etc/profile.d/doris.sh
+ export DORIS_HOME=Doris root path # example:/opt/doris
+ export PATH=$PATH:$DORIS_HOME/fe/bin:$DORIS_HOME/be/bin
+ # save and source
+ source /etc/profile.d/doris.sh
+ ```
+
+8. Start FE and BE and register BE to FE
+
+ ```shell
+ start_fe.sh --daemon
+ start_be.sh --daemon
+ ```
+
+ Check whether the FE startup is successful
+
+ > 1. Check whether the startup is successful, and whether there is a PaloFe
process under the JPS command
+ > 2. After the FE process is started, the metadata will be loaded first.
Depending on the role of the FE, you will see transfer from UNKNOWN to
MASTER/FOLLOWER/OBSERVER in the log. Finally, you will see the thrift server
started log, and you c
[GitHub] [incubator-doris] HappenLee opened a new issue, #9046: [Bug] Explain insert query always is verbose
HappenLee opened a new issue, #9046:
URL: https://github.com/apache/incubator-doris/issues/9046
### Search before asking
- [X] I had searched in the
[issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and
found no similar issues.
### Version
master
### What's Wrong?
`desc insert into lateral_view_join values
(1,1),(2,4),(3,8),(4,16),(5,32),(6,64),(7,128),(8,256),(9,512),(10,1024),(11,1),
(12,2),(13,3),(14,4),(15,5),(16,6);`
get the query plain：
```
+-+
| Explain String |
+-+
| PLAN FRAGMENT 0 |
| OUTPUT EXPRS: 1 | 1 |
| PARTITION: UNPARTITIONED |
| |
| OLAP TABLE SINK |
| TUPLE ID: 0 |
| RANDOM |
| |
| 0:UNION |
| constant exprs:|
| 1 | 1 |
| 2 | 4 |
| 3 | 8 |
| 4 | 16 |
| 5 | 32 |
| 6 | 64 |
| 7 | 128|
| 8 | 256|
| 9 | 512|
| 10 | 1024 |
| 11 | 1 |
| 12 | 2 |
| 13 | 3 |
| 14 | 4 |
| 15 | 5 |
| 16 | 6 |
| tuple ids: 1 |
| |
| Tuples: |
| TupleDescriptor{id=0, tbl=null, byteSize=12, materialized=true} |
| SlotDescriptor{id=0, col=k1, type=INT}|
| parent=0|
| materialized=true |
| byteSize=4 |
| byteOffset=4|
| nullIndicatorByte=0 |
| nullIndicatorBit=0 |
| slotIdx=0 |
| |
| SlotDescriptor{id=1, col=k2, type=INT}|
| parent=0|
| materialized=true |
| byteSize=4 |
| byteOffset=8|
| nullIndicatorByte=0 |
| nullIndicatorBit=1 |
| slotIdx=1 |
| |
| |
| TupleDescriptor{id=1, tbl=null, byteSize=12, materialized=true} |
| SlotDescriptor{id=2, col=null, type=INT} |
| parent=1|
| materialized=true |
| byteSize=4 |
| byteOffset=4|
| nullIndicatorByte=0 |
| nullIndicatorBit=0 |
| slotIdx=0 |
| |
| SlotDescriptor{id=3, col=null, type=INT} |
[GitHub] [incubator-doris] HappenLee opened a new pull request, #9047: [Bug] Support verbose/graph keyword in insert query stmt
HappenLee opened a new pull request, #9047: URL: https://github.com/apache/incubator-doris/pull/9047 # Proposed changes Issue Number: close #9046 ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior: (No) 2. Has unit tests been added: (No Need) 3. Has document been added or modified: (No Need) 4. Does it need to update dependencies: (No) 5. Are there any changes that cannot be rolled back: (Yes) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 closed pull request #9014: [Refactor][doc] Add best practice docs in advanced module
hf200012 closed pull request #9014: [Refactor][doc] Add best practice docs in advanced module URL: https://github.com/apache/incubator-doris/pull/9014 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9047: [Bug] Support verbose/graph keyword in insert query stmt
github-actions[bot] commented on PR #9047: URL: https://github.com/apache/incubator-doris/pull/9047#issuecomment-1099980380 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9047: [Bug] Support verbose/graph keyword in insert query stmt
github-actions[bot] commented on PR #9047: URL: https://github.com/apache/incubator-doris/pull/9047#issuecomment-1099980395 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] xinyiZzz commented on a diff in pull request #8994: [Fix]Crash caused by adding mem_tracker in get_next
xinyiZzz commented on code in PR #8994:
URL: https://github.com/apache/incubator-doris/pull/8994#discussion_r851163533
##
be/src/vec/exec/vexchange_node.cpp:
##
@@ -73,6 +73,8 @@ Status VExchangeNode::open(RuntimeState* state) {
RETURN_IF_ERROR(_stream_recvr->create_merger(_vsort_exec_exprs.lhs_ordering_expr_ctxs(),
_is_asc_order,
_nulls_first,
state->batch_size(),
_limit, _offset));
+} else {
+ADD_THREAD_LOCAL_MEM_TRACKER(_stream_recvr->mem_tracker());
Review Comment:
Thx for your fix,
Is the crash in the first line of `thread_mem_tracker_mgr.h::add_tracker`
`DCHECK(_mem_trackers.find(mem_tracker->id()) == _mem_trackers.end());`?
I'm working on a complete fix for this, and this DCHECK may be commented out
shortly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] HappenLee commented on issue #9034: [Bug] The is-null predicate in the where statement cannot be pushed down to the storage layer
HappenLee commented on issue #9034: URL: https://github.com/apache/incubator-doris/issues/9034#issuecomment-1099982613 Can you please give the create table stmt of `tbla`, Thank you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] qzsee commented on issue #9034: [Bug] The is-null predicate in the where statement cannot be pushed down to the storage layer
qzsee commented on issue #9034:
URL:
https://github.com/apache/incubator-doris/issues/9034#issuecomment-1099987525
> Can you please give the create table stmt of `tbla`, Thank you.
CREATE TABLE `tbla` (
`dt` int(11) NULL,
`k1` int(11) NULL,
`k2` bigint(20) NULL,
`k3` bigint(20) NULL,
`k4` bigint(20) NULL,
`k5` bigint(20) NULL,
`k6` bigint(20) NULL,
`k7` bigint(20) NULL,
`k8` bigint(20) NULL,
`k9` bigint(20) NULL,
`k10` bigint(20) NULL,
`k11` bigint(20) NULL,
`k12` bigint(20) NULL,
`k13` bigint(20) NULL,
`k14` bigint(20) NULL,
`k15` bigint(20) NULL,
`k16` varchar(128) NULL
) ENGINE=OLAP
DUPLICATE KEY(`k1`, `k2`, `k3`, `k4`, `k5`, `k6`)
PARTITION BY RANGE(`k1`)
(PARTITION p20220410 VALUES [("20220409"), ("20220410")),
PARTITION p20220411 VALUES [("20220410"), ("20220411")),
PARTITION p20220412 VALUES [("20220411"), ("20220412")))
DISTRIBUTED BY HASH(`k3`) BUCKETS 5
PROPERTIES (
"replication_num" = "3",
"in_memory" = "false",
"storage_format" = "V2"
);
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] smallhibiscus opened a new pull request, #9049: [Refactor][doc] Add best practice docs in advanced module
smallhibiscus opened a new pull request, #9049: URL: https://github.com/apache/incubator-doris/pull/9049 # Proposed changes Issue Number: close #xxx ## Problem Summary: Add best practice docs in advanced module. ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] jackwener opened a new pull request, #9050: [feature](optimizer): spilt implicit `is not null`
jackwener opened a new pull request, #9050: URL: https://github.com/apache/incubator-doris/pull/9050 # Proposed changes Issue Number: close #9042 ## Problem Summary: ## Checklist(Required) 1. Does it affect the original behavior: (No) 2. Has unit tests been added: (Yes) 3. Has document been added or modified: (No Need) 4. Does it need to update dependencies: (No) 5. Are there any changes that cannot be rolled back: (No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #9049: [Refactor][doc] Add best practice docs in advanced module
hf200012 merged PR #9049: URL: https://github.com/apache/incubator-doris/pull/9049 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated (556602a5f1 -> 6215e5b09f)
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git from 556602a5f1 [Refactor][Doc]Add part of the document content for Get-Starting (#8867) add 6215e5b09f Add best practice docs in advanced module (#9049) No new revisions were added by this update. Summary of changes: new-docs/.vuepress/sidebar/en.js | 10 + new-docs/.vuepress/sidebar/zh-CN.js| 10 + new-docs/en/advanced/best-practice/debug-log.md| 121 + .../en/advanced/best-practice/import-analysis.md | 171 +++ .../en/advanced/best-practice/query-analysis.md| 499 .../update-delete/batch-delete-manual.md | 2 +- new-docs/en/data-operate/update-delete/update.md | 4 +- new-docs/zh-CN/advanced/best-practice/debug-log.md | 120 + .../advanced/best-practice/import-analysis.md | 170 +++ .../zh-CN/advanced/best-practice/query-analysis.md | 501 + .../update-delete/batch-delete-manual.md | 2 +- new-docs/zh-CN/data-table/best-practice.md | 173 ++- 12 files changed, 1779 insertions(+), 4 deletions(-) create mode 100644 new-docs/en/advanced/best-practice/debug-log.md create mode 100644 new-docs/en/advanced/best-practice/import-analysis.md create mode 100644 new-docs/en/advanced/best-practice/query-analysis.md create mode 100644 new-docs/zh-CN/advanced/best-practice/debug-log.md create mode 100644 new-docs/zh-CN/advanced/best-practice/import-analysis.md create mode 100644 new-docs/zh-CN/advanced/best-practice/query-analysis.md - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] jackwener commented on a diff in pull request #9018: [feature](optimizer): rewrite expr self compare
jackwener commented on code in PR #9018: URL: https://github.com/apache/incubator-doris/pull/9018#discussion_r851173140 ## fe/fe-core/src/test/java/org/apache/doris/rewrite/RewriteSelfCmpRuleTest.java: ## @@ -0,0 +1,87 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements. See the NOTICE file +// distributed with this work for additional information +// regarding copyright ownership. The ASF licenses this file +// to you under the Apache License, Version 2.0 (the +// "License"); you may not use this file except in compliance +// with the License. You may obtain a copy of the License at +// +// http://www.apache.org/licenses/LICENSE-2.0 +// +// Unless required by applicable law or agreed to in writing, +// software distributed under the License is distributed on an +// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +// KIND, either express or implied. See the License for the +// specific language governing permissions and limitations +// under the License.package org.apache.doris.rewrite; + Review Comment: package -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9035: [Bug] fix is-null predicate in the where statement cannot be pushed down storage engine
github-actions[bot] commented on PR #9035: URL: https://github.com/apache/incubator-doris/pull/9035#issuecomment-102892 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9035: [Bug] fix is-null predicate in the where statement cannot be pushed down storage engine
github-actions[bot] commented on PR #9035: URL: https://github.com/apache/incubator-doris/pull/9035#issuecomment-102876 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] jackwener commented on a diff in pull request #9050: [feature](optimizer): spilt implicit `is not null`
jackwener commented on code in PR #9050:
URL: https://github.com/apache/incubator-doris/pull/9050#discussion_r851174972
##
fe/fe-core/src/main/java/org/apache/doris/rewrite/RewriteInferNotNullRule.java:
##
@@ -0,0 +1,115 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.rewrite;
+
+import java.util.function.BinaryOperator;
+
+import org.apache.doris.analysis.Analyzer;
+import org.apache.doris.analysis.BetweenPredicate;
+import org.apache.doris.analysis.BinaryPredicate;
+import org.apache.doris.analysis.CompoundPredicate;
+import org.apache.doris.analysis.InPredicate;
+import org.apache.doris.analysis.LikePredicate;
+import org.apache.doris.analysis.NullLiteral;
+import org.apache.doris.analysis.Expr;
+import org.apache.doris.analysis.IsNullPredicate;
+import org.apache.doris.analysis.Predicate;
+import org.apache.doris.analysis.SlotRef;
+import org.apache.doris.common.AnalysisException;
+
+/*-
+ * Infer `IS NOT NULL` from predicate in whereClause.
+ * And spilt it into two parts.
+ * Example:
+ * Where col > 0; -> Where col > 0 and col is not null;
+ * Where col1 = col2; -> Where (col2 is not null) and (col1 is not null and
col1 = col2);
+ */
+public class RewriteInferNotNullRule implements ExprRewriteRule {
+public static ExprRewriteRule INSTANCE = new RewriteInferNotNullRule();
+
+@Override
+public Expr apply(Expr expr, Analyzer analyzer, ExprRewriter.ClauseType
clauseType) throws AnalysisException {
+if (clauseType != ExprRewriter.ClauseType.WHERE_CLAUSE || !(expr
instanceof Predicate)) {
+return expr;
+}
+
+Predicate predicate = (Predicate) expr;
+Expr leftExpr = predicate.getChild(0);
+Expr rightExpr = predicate.getChild(1);
+if (leftExpr == null || rightExpr == null) {
+return expr;
+}
+
+if (predicate instanceof BinaryPredicate) {
+/**
Review Comment:
TODO: Trim `same`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] jackwener commented on a diff in pull request #9050: [feature](optimizer): spilt implicit `is not null`
jackwener commented on code in PR #9050:
URL: https://github.com/apache/incubator-doris/pull/9050#discussion_r851174972
##
fe/fe-core/src/main/java/org/apache/doris/rewrite/RewriteInferNotNullRule.java:
##
@@ -0,0 +1,115 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.doris.rewrite;
+
+import java.util.function.BinaryOperator;
+
+import org.apache.doris.analysis.Analyzer;
+import org.apache.doris.analysis.BetweenPredicate;
+import org.apache.doris.analysis.BinaryPredicate;
+import org.apache.doris.analysis.CompoundPredicate;
+import org.apache.doris.analysis.InPredicate;
+import org.apache.doris.analysis.LikePredicate;
+import org.apache.doris.analysis.NullLiteral;
+import org.apache.doris.analysis.Expr;
+import org.apache.doris.analysis.IsNullPredicate;
+import org.apache.doris.analysis.Predicate;
+import org.apache.doris.analysis.SlotRef;
+import org.apache.doris.common.AnalysisException;
+
+/*-
+ * Infer `IS NOT NULL` from predicate in whereClause.
+ * And spilt it into two parts.
+ * Example:
+ * Where col > 0; -> Where col > 0 and col is not null;
+ * Where col1 = col2; -> Where (col2 is not null) and (col1 is not null and
col1 = col2);
+ */
+public class RewriteInferNotNullRule implements ExprRewriteRule {
+public static ExprRewriteRule INSTANCE = new RewriteInferNotNullRule();
+
+@Override
+public Expr apply(Expr expr, Analyzer analyzer, ExprRewriter.ClauseType
clauseType) throws AnalysisException {
+if (clauseType != ExprRewriter.ClauseType.WHERE_CLAUSE || !(expr
instanceof Predicate)) {
+return expr;
+}
+
+Predicate predicate = (Predicate) expr;
+Expr leftExpr = predicate.getChild(0);
+Expr rightExpr = predicate.getChild(1);
+if (leftExpr == null || rightExpr == null) {
+return expr;
+}
+
+if (predicate instanceof BinaryPredicate) {
+/**
Review Comment:
TODO: Trim same col
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] dependabot[bot] commented on pull request #9040: Bump async from 2.6.3 to 2.6.4 in /new-docs
dependabot[bot] commented on PR #9040: URL: https://github.com/apache/incubator-doris/pull/9040#issuecomment-118675 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting `@dependabot ignore this major version` or `@dependabot ignore this minor version`. If you change your mind, just re-open this PR and I'll resolve any conflicts on it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman closed pull request #9040: Bump async from 2.6.3 to 2.6.4 in /new-docs
morningman closed pull request #9040: Bump async from 2.6.3 to 2.6.4 in /new-docs URL: https://github.com/apache/incubator-doris/pull/9040 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] dependabot[bot] commented on pull request #9039: Bump hadoop-common from 2.8.0 to 3.2.3 in /regression-test/framework
dependabot[bot] commented on PR #9039: URL: https://github.com/apache/incubator-doris/pull/9039#issuecomment-118788 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting `@dependabot ignore this major version` or `@dependabot ignore this minor version`. If you change your mind, just re-open this PR and I'll resolve any conflicts on it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman closed pull request #9039: Bump hadoop-common from 2.8.0 to 3.2.3 in /regression-test/framework
morningman closed pull request #9039: Bump hadoop-common from 2.8.0 to 3.2.3 in /regression-test/framework URL: https://github.com/apache/incubator-doris/pull/9039 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8971: [improvement](sql_block_rule) optimization of alter sql_block_rule stmt
github-actions[bot] commented on PR #8971: URL: https://github.com/apache/incubator-doris/pull/8971#issuecomment-1100011105 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8971: [improvement](sql_block_rule) optimization of alter sql_block_rule stmt
github-actions[bot] commented on PR #8971: URL: https://github.com/apache/incubator-doris/pull/8971#issuecomment-1100011127 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] Lchangliang commented on a diff in pull request #8923: [Feature] Support compression prop
Lchangliang commented on code in PR #8923:
URL: https://github.com/apache/incubator-doris/pull/8923#discussion_r851190905
##
be/src/olap/tablet_schema.h:
##
@@ -169,6 +172,7 @@ class TabletSchema {
size_t _num_short_key_columns = 0;
size_t _num_rows_per_row_block = 0;
CompressKind _compress_kind = COMPRESS_NONE;
+segment_v2::CompressionTypePB _compression_type =
segment_v2::CompressionTypePB::NO_COMPRESSION;
Review Comment:
I think it is just a zero value. It will be set after creation like
_compress_kind.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] Lchangliang commented on a diff in pull request #8923: [Feature] Support compression prop
Lchangliang commented on code in PR #8923:
URL: https://github.com/apache/incubator-doris/pull/8923#discussion_r851191311
##
gensrc/thrift/AgentService.thrift:
##
@@ -105,6 +115,7 @@ struct TCreateTabletReq {
13: optional TStorageFormat storage_format
14: optional TTabletType tablet_type
15: optional TStorageParam storage_param
+16: optional TCompressionType compression_type
Review Comment:
Thank you for your advice.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] mrhhsg closed pull request #8994: [Fix]Crash caused by adding mem_tracker in get_next
mrhhsg closed pull request #8994: [Fix]Crash caused by adding mem_tracker in get_next URL: https://github.com/apache/incubator-doris/pull/8994 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] mrhhsg commented on a diff in pull request #8994: [Fix]Crash caused by adding mem_tracker in get_next
mrhhsg commented on code in PR #8994:
URL: https://github.com/apache/incubator-doris/pull/8994#discussion_r851194612
##
be/src/vec/exec/vexchange_node.cpp:
##
@@ -73,6 +73,8 @@ Status VExchangeNode::open(RuntimeState* state) {
RETURN_IF_ERROR(_stream_recvr->create_merger(_vsort_exec_exprs.lhs_ordering_expr_ctxs(),
_is_asc_order,
_nulls_first,
state->batch_size(),
_limit, _offset));
+} else {
+ADD_THREAD_LOCAL_MEM_TRACKER(_stream_recvr->mem_tracker());
Review Comment:
Yes, and I will close the PR since you are working on it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 opened a new pull request, #9051: [Refactor][doc]add show load warning
hf200012 opened a new pull request, #9051: URL: https://github.com/apache/incubator-doris/pull/9051 add show load warning # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9051: [Refactor][doc]add show load warning
github-actions[bot] commented on PR #9051: URL: https://github.com/apache/incubator-doris/pull/9051#issuecomment-1100036484 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9051: [Refactor][doc]add show load warning
github-actions[bot] commented on PR #9051: URL: https://github.com/apache/incubator-doris/pull/9051#issuecomment-1100036500 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #9051: [Refactor][doc]add show load warning
hf200012 merged PR #9051: URL: https://github.com/apache/incubator-doris/pull/9051 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated: add show load warning (#9051)
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 34457cd768 add show load warning (#9051) 34457cd768 is described below commit 34457cd768a3027683b7a7e5a0397624b6d6698a Author: jiafeng.zhang AuthorDate: Fri Apr 15 18:53:20 2022 +0800 add show load warning (#9051) add show load warning --- .../Show-Statements/SHOW-LOAD-PROFILE.md | 147 + .../Show-Statements/SHOW-LOAD-WARNINGS.md | 28 .../Show-Statements/SHOW-LOAD-PROFILE.md | 147 + .../Show-Statements/SHOW-LOAD-WARNINGS.md | 28 4 files changed, 350 insertions(+) diff --git a/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md b/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md index 9bdcad5da3..1382f81642 100644 --- a/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md +++ b/new-docs/en/sql-manual/sql-reference-v2/Show-Statements/SHOW-LOAD-PROFILE.md @@ -26,10 +26,157 @@ under the License. ## SHOW-LOAD-PROFILE +### Name + +SHOW LOAD PROFILE + ### Description +This statement is used to view the Profile information of the import operation. This function requires the user to open the Profile settings. The versions before 0.15 perform the following settings: + +```sql +SET is_report_success=true; + + +Versions 0.15 and later perform the following settings: + +```sql +SET [GLOBAL] enable_profile=true; + + +grammar: + +```sql +show load profile "/"; + +show load profile "/[queryId]" + + +This command will list all currently saved import profiles. Each line corresponds to one import. where the QueryId column is the ID of the import job. This ID can also be viewed through the SHOW LOAD statement. We can select the QueryId corresponding to the Profile we want to see to see the specific situation + ### Example +1. List all Load Profiles + + ```sql + mysql> show load profile "/"; + +-+--+---+--+---+-+-+---++ + | QueryId | User | DefaultDb | SQL | QueryType | StartTime | EndTime | TotalTime | QueryState | + +-+--+---+--+---+-+-+---++ + | 10441 | N/A | N/A | N/A | Load | 2021-04-10 22:15:37 | 2021-04-10 22:18:54 | 3m17s | N/A| + +-+--+---+--+---+-+-+---++ + 2 rows in set (0.00 sec) + + +2. View an overview of the subtasks with imported jobs: + + ```sql + mysql> show load profile "/10441"; + +---++ + | TaskId| ActiveTime | + +---++ + | 980014623046410a-88e260f0c43031f1 | 3m14s | + +---++ + + +3. View the Instance overview of the specified subtask + + ```sql + mysql> show load profile "/10441/980014623046410a-88e260f0c43031f1"; + +---+--++ + | Instances | Host | ActiveTime | + +---+--++ + | 980014623046410a-88e260f0c43031f2 | 10.81.85.89:9067 | 3m7s | + | 980014623046410a-88e260f0c43031f3 | 10.81.85.89:9067 | 3m6s | + | 980014623046410a-88e260f0c43031f4 | 10.81.85.89:9067 | 3m10s | + | 980014623046410a-88e260f0c43031f5 | 10.81.85.89:9067 | 3m14s | + +---+--++ + + +4. Continue to view the detailed Profile of each operator on a specific Instance + + ```sql + mysql> show load profile "/10441/980014623046410a-88e260f0c43031f1/980014623046410a-88e260f0c43031f5"\G + + *** 1. row *** + + Instance: + + ┌-┐ + + │[-1: OlapTableSink] │ + + │(Active: 2m17s, non-child: 70.91)│ + + │ - Counters:│ + + │ - CloseWaitTime: 1m53s │ + + │ - ConvertBatchTime: 0ns│ + + │ - MaxAddBatchExecTime: 1m46s │ + + │ - NonBlockingSendTime: 3m11s │ + + │ - NumberBatchAdded: 782│ + + │ - NumberNodeChannels: 1│ + + │ - OpenTime: 743.822us │ + + │ - RowsFiltered: 0 │ +
[GitHub] [incubator-doris] JNSimba opened a new pull request, #9052: [Refactor][Doc] Add Doc For Performance Testing
JNSimba opened a new pull request, #9052: URL: https://github.com/apache/incubator-doris/pull/9052 # Proposed changes Issue Number: close #xxx ## Problem Summary: add tpch and ssb performance testing ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #9052: [Refactor][Doc] Add Doc For Performance Testing
hf200012 merged PR #9052: URL: https://github.com/apache/incubator-doris/pull/9052 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated (34457cd768 -> 2c7327fb7c)
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git from 34457cd768 add show load warning (#9051) add 2c7327fb7c add doc tpch and ssb (#9052) No new revisions were added by this update. Summary of changes: new-docs/en/benchmark/ssb.md | 2 +- new-docs/en/benchmark/tpc-h.md| 188 -- new-docs/zh-CN/benchmark/ssb.md | 157 ++- new-docs/zh-CN/benchmark/tpc-h.md | 85 - 4 files changed, 299 insertions(+), 133 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] smallhibiscus opened a new pull request, #9053: [Refactor][doc] Fix bad link in documentation
smallhibiscus opened a new pull request, #9053: URL: https://github.com/apache/incubator-doris/pull/9053 # Proposed changes Issue Number: close #xxx ## Problem Summary: Fix bad link in documentation. ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #9053: [Refactor][doc] Fix bad link in documentation
hf200012 merged PR #9053: URL: https://github.com/apache/incubator-doris/pull/9053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated: [Refactor][doc] Fix bad link in documentation (#9053)
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new c431da3bf8 [Refactor][doc] Fix bad link in documentation (#9053) c431da3bf8 is described below commit c431da3bf8d5c0c6906ffa47475f403fa483168b Author: smallhibiscus <844981...@qq.com> AuthorDate: Fri Apr 15 19:50:35 2022 +0800 [Refactor][doc] Fix bad link in documentation (#9053) Fix bad link in documentation --- .../cluster-management/elastic-expansion.md| 4 +-- new-docs/zh-CN/admin-manual/data-admin/backup.md | 2 +- .../admin-manual/data-admin/delete-recover.md | 2 +- new-docs/zh-CN/admin-manual/data-admin/restore.md | 2 +- .../maint-monitor/metadata-operation.md| 4 +-- .../zh-CN/advanced/alter-table/schema-change.md| 4 +-- .../advanced/partition/table-tmp-partition.md | 2 +- new-docs/zh-CN/advanced/resource.md| 2 +- new-docs/zh-CN/advanced/small-file-mgr.md | 4 +-- new-docs/zh-CN/advanced/variables.md | 10 +++ .../zh-CN/data-operate/export/export-manual.md | 2 +- .../import/import-scenes/kafka-load.md | 4 +-- .../import/import-way/binlog-load-manual.md| 10 +++ .../import/import-way/routine-load-manual.md | 2 +- .../import/import-way/spark-load-manual.md | 2 +- new-docs/zh-CN/data-operate/import/load-manual.md | 2 +- new-docs/zh-CN/data-table/hit-the-rollup.md| 4 +-- new-docs/zh-CN/data-table/index/bitmap-index.md| 2 +- .../sql-reference-v2/Show-Statements/SHOW-FILE.md | 31 +- 19 files changed, 62 insertions(+), 33 deletions(-) diff --git a/new-docs/zh-CN/admin-manual/cluster-management/elastic-expansion.md b/new-docs/zh-CN/admin-manual/cluster-management/elastic-expansion.md index f927cf243b..da8c275505 100644 --- a/new-docs/zh-CN/admin-manual/cluster-management/elastic-expansion.md +++ b/new-docs/zh-CN/admin-manual/cluster-management/elastic-expansion.md @@ -96,7 +96,7 @@ FE 分为 Leader，Follower 和 Observer 三种角色。 默认一个集群， 以上方式，都需要 Doris 的 root 用户权限。 -BE 节点的扩容和缩容过程，不影响当前系统运行以及正在执行的任务，并且不会影响当前系统的性能。数据均衡会自动进行。根据集群现有数据量的大小，集群会在几个小时到1天不等的时间内，恢复到负载均衡的状态。集群负载情况，可以参见 [Tablet 负载均衡文档](../administrator-guide/operation/tablet-repair-and-balance.md)。 +BE 节点的扩容和缩容过程，不影响当前系统运行以及正在执行的任务，并且不会影响当前系统的性能。数据均衡会自动进行。根据集群现有数据量的大小，集群会在几个小时到1天不等的时间内，恢复到负载均衡的状态。集群负载情况，可以参见 [Tablet 负载均衡文档](../maint-monitor/tablet-meta-tool.html)。 ### 增加 BE 节点 @@ -128,7 +128,7 @@ DECOMMISSION 语句如下： > ```CANCEL DECOMMISSION BACKEND "be_host:be_heartbeat_service_port";``` > 命令取消。取消后，该 BE 上的数据将维持当前剩余的数据量。后续 Doris 重新进行负载均衡 -**对于多租户部署环境下，BE 节点的扩容和缩容，请参阅 [多租户设计文档](../administrator-guide/operation/multi-tenant.md)。** +**对于多租户部署环境下，BE 节点的扩容和缩容，请参阅 [多租户设计文档](../multi-tenant.html)。** ## Broker 扩容缩容 diff --git a/new-docs/zh-CN/admin-manual/data-admin/backup.md b/new-docs/zh-CN/admin-manual/data-admin/backup.md index 372f5cfd7d..fab3d3678e 100644 --- a/new-docs/zh-CN/admin-manual/data-admin/backup.md +++ b/new-docs/zh-CN/admin-manual/data-admin/backup.md @@ -206,4 +206,4 @@ BACKUP的更多用法可参考 [这里](../../sql-manual/sql-reference-v2/Show-S ## 更多帮助 - 关于 BACKUP 使用的更多详细语法及最佳实践，请参阅 [BACKUP](../../sql-reference-v2/Data-Definition-Statements/Backup-and-Restore/BACKUP.html) 命令手册，你也可以在 MySql 客户端命令行下输入 `HELP BACKUP` 获取更多帮助信息。 \ No newline at end of file + 关于 BACKUP 使用的更多详细语法及最佳实践，请参阅 [BACKUP](../../sql-manual/sql-reference-v2/Data-Definition-Statements/Backup-and-Restore/BACKUP.html) 命令手册，你也可以在 MySql 客户端命令行下输入 `HELP BACKUP` 获取更多帮助信息。 \ No newline at end of file diff --git a/new-docs/zh-CN/admin-manual/data-admin/delete-recover.md b/new-docs/zh-CN/admin-manual/data-admin/delete-recover.md index 69688fb70d..a54e0923d3 100644 --- a/new-docs/zh-CN/admin-manual/data-admin/delete-recover.md +++ b/new-docs/zh-CN/admin-manual/data-admin/delete-recover.md @@ -50,4 +50,4 @@ RECOVER PARTITION p1 FROM example_tbl; ## 更多帮助 -关于 RECOVER 使用的更多详细语法及最佳实践，请参阅 [RECOVER](../../sql-reference-v2/Data-Definition-Statements/Backup-and-Restore/RECOVER.html) 命令手册，你也可以在 MySql 客户端命令行下输入 `HELP RECOVER` 获取更多帮助信息。 \ No newline at end of file +关于 RECOVER 使用的更多详细语法及最佳实践，请参阅 [RECOVER](../../sql-manual/sql-reference-v2/Data-Definition-Statements/Backup-and-Restore/RECOVER.html) 命令手册，你也可以在 MySql 客户端命令行下输入 `HELP RECOVER` 获取更多帮助信息。 \ No newline at end of file diff --git a/new-docs/zh-CN/admin-manual/data-admin/restore.md b/new-docs/zh-CN/admin-manual/data-admin/restore.md index bcdc6ae744..c428958eec 100644 --- a/new-docs/zh-CN/admin-manual/data-admin/restore.md +++ b/new-docs/zh-CN/admin-manual/data-admin/restore.md @@ -180,5 +180,5 @@ RESTORE的更多用法可参考 [这里](../../sql-manual/sql-reference-v2/Show- ## 更多帮助 -关于 RESTORE 使用的更多详细语法及最佳实践，请参阅 [RESTORE](../../sql-refere
[GitHub] [incubator-doris] dataalive commented on issue #9033: [Bug] window function `lag` return invalid data
dataalive commented on issue #9033: URL: https://github.com/apache/incubator-doris/issues/9033#issuecomment-1100073633 does function ```lead``` also have problem ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] weilai201 commented on issue #4961: decimal value is not valid for definition
weilai201 commented on issue #4961: URL: https://github.com/apache/incubator-doris/issues/4961#issuecomment-1100079889 我也发现0.15.0版本中也存在问题，我有一张表定义decimal(20)长度，但是19位的数据都存储不进去。不知道如何解决或者绕开这个问题。 @HappenLee -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8987: [community](*): polish config about project
github-actions[bot] commented on PR #8987: URL: https://github.com/apache/incubator-doris/pull/8987#issuecomment-1100116303 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8987: [community](*): polish config about project
github-actions[bot] commented on PR #8987: URL: https://github.com/apache/incubator-doris/pull/8987#issuecomment-1100116321 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] weilai201 opened a new issue, #9054: [Bug] decimal value is not valid for definition
weilai201 opened a new issue, #9054: URL: https://github.com/apache/incubator-doris/issues/9054 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 0.15.0-rc4 ### What's Wrong? I have a column which named `F_B718ADEC73E04CE3EC720DD11A06A308` and data type is `DECIMAL(20)`. When I insert `1152204005154225920` value ( the length is 19 ) into this column, Occur error '`Reason: decimal value is not valid for definition, column=F_B718ADEC73E04CE3EC720DD11A06A308, value=1152204005154225920, precision=20, scale=0. src line: [];’`. How can i resolve it. Please help me! Thank you! ### What You Expected? The value `1152204005154225920` can insert into the column `F_B718ADEC73E04CE3EC720DD11A06A308` ,which data type is `DECIMAL(20)` ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] adonis0147 opened a new issue, #9055: [feature-wip](array-type) Add array aggregation functions
adonis0147 opened a new issue, #9055:
URL: https://github.com/apache/incubator-doris/issues/9055
### Search before asking
- [X] I had searched in the
[issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and
found no similar issues.
### Description
This issue is a sub task of #7570 .
Add aggregation functions for array type:
1. `array_min`
2. `array_max`
3. `array_sum`
4. `array_avg`
5. `array_product`
### Use case
```shell
mysql> create table array_type_table(k1 INT, k2 Array) duplicate key
(k1)
-> distributed by hash(k1) buckets 1 properties('replication_num' = '1');
mysql> insert into array_type_table values (0, []), (1, [1, 2, 3]);
mysql> set enable_vectorized_engine = true;# enable vectorized engine
mysql> select k2, array_min(k2) from array_type_table;
+---+-+
| k2| array_min(`k2`) |
+---+-+
| []| 0 |
| [1, 2, 3] | 1 |
+---+-+
2 rows in set (0.01 sec)
mysql> select k2, array_max(k2) from array_type_table;
+---+-+
| k2| array_max(`k2`) |
+---+-+
| []| 0 |
| [1, 2, 3] | 3 |
+---+-+
2 rows in set (0.02 sec)
mysql> select k2, array_sum(k2) from array_type_table;
+---+-+
| k2| array_sum(`k2`) |
+---+-+
| []| 0 |
| [1, 2, 3] | 6 |
+---+-+
2 rows in set (0.01 sec)
mysql> select k2, array_avg(k2) from array_type_table;
+---+-+
| k2| array_avg(`k2`) |
+---+-+
| []| 0 |
| [1, 2, 3] | 2 |
+---+-+
2 rows in set (0.01 sec)
mysql> select k2, array_product(k2) from array_type_table;
+---+-+
| k2| array_product(`k2`) |
+---+-+
| []| 0 |
| [1, 2, 3] | 6 |
+---+-+
2 rows in set (0.02 sec)
```
### Related issues
#7570
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of
Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] adonis0147 opened a new pull request, #9056: [feature-wip](array-type) Add array aggregation functions
adonis0147 opened a new pull request, #9056: URL: https://github.com/apache/incubator-doris/pull/9056 # Proposed changes Issue Number: close #9055 ## Problem Summary: Please refer to #9055 ## Checklist(Required) 1. Does it affect the original behavior: No 2. Has unit tests been added: Yes 3. Has document been added or modified: No 4. Does it need to update dependencies: No 5. Are there any changes that cannot be rolled back: No ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] yangzhg commented on a diff in pull request #8987: [community](*): polish config about project
yangzhg commented on code in PR #8987: URL: https://github.com/apache/incubator-doris/pull/8987#discussion_r851565757 ## .gitignore: ## @@ -1,88 +1,77 @@ +# ignore file with wildcard anywhere *.swp *.pyc -be/output -be/build -be/build_Release -be/ut_build -output -docs/contents -docs/.temp -docs/.vuepress/dist -docs/node_modules -docs/build -gensrc/build -fe/fe-core/target -thirdparty/src -thirdparty/installed -*.so.tmp -.DS_Store +*.class *.iml +*.swp +*.jar +*.zip +*.gz +*.log +*.so.tmp +*.flattened-pom.xml core.* -extension/**/.classpath -extension/**/target -nohup.out -fe/log +# ignore file with specifiy name anywhere +.DS_Store +.classpath +nohup.out custom_env.sh -ut_dir -log/ -fe_plugins/**/target -fe_plugins/output -fe/mocked -fe/**/target +derby.log dependency-reduced-pom.xml -fe_plugins/**/.classpath +package-lock.json +yarn.lock + +# ignore all sub `/bin` and `/build` directory +**/build/ +**/bin/ Review Comment: What if I want to modify start.sh in bin? ## .gitignore: ## @@ -1,88 +1,77 @@ +# ignore file with wildcard anywhere *.swp *.pyc -be/output -be/build -be/build_Release -be/ut_build -output -docs/contents -docs/.temp -docs/.vuepress/dist -docs/node_modules -docs/build -gensrc/build -fe/fe-core/target -thirdparty/src -thirdparty/installed -*.so.tmp -.DS_Store +*.class *.iml +*.swp +*.jar +*.zip +*.gz +*.log +*.so.tmp +*.flattened-pom.xml core.* -extension/**/.classpath -extension/**/target -nohup.out -fe/log +# ignore file with specifiy name anywhere +.DS_Store +.classpath +nohup.out custom_env.sh -ut_dir -log/ -fe_plugins/**/target -fe_plugins/output -fe/mocked -fe/**/target +derby.log dependency-reduced-pom.xml -fe_plugins/**/.classpath +package-lock.json +yarn.lock + +# ignore all sub `/bin` and `/build` directory +**/build/ +**/bin/ +**/target/ +**/node_modules/ +**/dist/ +**/log/ + +# ignore project file +.cproject +.project +.settings/ +**/.idea/ +**/.vscode/ + +# docs +docs/contents/ +docs/.temp + +# output, thirdparty, extension +output/ +conf/ +rpc_data/ +thirdparty/src +thirdparty/installed + +fe_plugins/output fe_plugins/**/.factorypath -samples/**/.classpath -fe/fe-core/src/main/resources/static/ + fs_brokers/apache_hdfs_broker/src/main/resources/ fs_brokers/apache_hdfs_broker/src/main/thrift/ + +# regression-test +regression-test/framework/dependency-reduced-pom.xml + samples/doris-demo/remote-udf-python-demo/*_pb2.py samples/doris-demo/remote-udf-python-demo/*_pb2_grpc.py samples/doris-demo/remote-udf-cpp-demo/*.o samples/doris-demo/remote-udf-cpp-demo/*.pb.h samples/doris-demo/remote-udf-cpp-demo/*.pb.cc samples/doris-demo/remote-udf-cpp-demo/function_server_demo -regression-test/framework/target -regression-test/framework/dependency-reduced-pom.xml -# ignore eclipse project file & idea project file -.cproject -.project -.settings/ -.idea/ -/Default/ -be/cmake-build -be/cmake-build-debug -be/cmake-build-release -be/.vscode -be/src/gen_cpp/*.cc -be/src/gen_cpp/*.cpp -be/src/gen_cpp/*.h +# FE +fe/mocked/ +fe/fe-core/src/main/resources/static/ + +# BE +be/*build*/ Review Comment: his modification is too broad. Why don't we sort out the output directory and put them all in one directory? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 opened a new pull request, #9057: [fix][doc]Data import document modification
hf200012 opened a new pull request, #9057: URL: https://github.com/apache/incubator-doris/pull/9057 [fix][doc]Data import document modification # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] yiguolei commented on a diff in pull request #9005: [Refactor](ReportHanlder) Remove some unused schema_hash code
yiguolei commented on code in PR #9005:
URL: https://github.com/apache/incubator-doris/pull/9005#discussion_r851573765
##
fe/fe-core/src/main/java/org/apache/doris/master/ReportHandler.java:
##
@@ -665,67 +662,42 @@ private static void deleteFromMeta(ListMultimap tabletDeleteFromMeta
}
private static void deleteFromBackend(Map backendTablets,
- Set
foundTabletsWithValidSchema,
- Map
foundTabletsWithInvalidSchema,
+ Set tabletFoundInMeta,
long backendId) {
int deleteFromBackendCounter = 0;
int addToMetaCounter = 0;
AgentBatchTask batchTask = new AgentBatchTask();
-// This means that the meta of all backend tablets can be found in fe,
we only need to process tablets with invalid Schema
-if (foundTabletsWithValidSchema.size() +
foundTabletsWithInvalidSchema.size() == backendTablets.size()) {
-for (Long tabletId : foundTabletsWithInvalidSchema.keySet()) {
-// this tablet is found in meta but with invalid schema hash.
delete it.
-int schemaHash =
foundTabletsWithInvalidSchema.get(tabletId).getSchemaHash();
-DropReplicaTask task = new DropReplicaTask(backendId,
tabletId, schemaHash);
+for (Long tabletId : backendTablets.keySet()) {
+TTablet backendTablet = backendTablets.get(tabletId);
+TTabletInfo backendTabletInfo =
backendTablet.getTabletInfos().get(0);
+boolean needDelete = false;
Review Comment:
If tablet is not find in tablet meta, then the tablet is not deleted?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9057: [fix][doc]Data import document modification
github-actions[bot] commented on PR #9057: URL: https://github.com/apache/incubator-doris/pull/9057#issuecomment-1100511300 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9057: [fix][doc]Data import document modification
github-actions[bot] commented on PR #9057: URL: https://github.com/apache/incubator-doris/pull/9057#issuecomment-1100511297 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 merged pull request #9057: [fix][doc]Data import document modification
hf200012 merged PR #9057: URL: https://github.com/apache/incubator-doris/pull/9057 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9005: [Refactor](ReportHanlder) Remove some unused schema_hash code
github-actions[bot] commented on PR #9005: URL: https://github.com/apache/incubator-doris/pull/9005#issuecomment-1100512879 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #9005: [Refactor](ReportHanlder) Remove some unused schema_hash code
github-actions[bot] commented on PR #9005: URL: https://github.com/apache/incubator-doris/pull/9005#issuecomment-1100512882 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman merged pull request #8971: [fix](sql_block_rule) optimization of alter sql_block_rule stmt
morningman merged PR #8971: URL: https://github.com/apache/incubator-doris/pull/8971 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman closed issue #8758: [Bug] Get unexpected result for alter sql_block_rule stmt
morningman closed issue #8758: [Bug] Get unexpected result for alter sql_block_rule stmt URL: https://github.com/apache/incubator-doris/issues/8758 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated: [fix](sql_block_rule) optimization of alter sql_block_rule stmt (#8971)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git
The following commit(s) were added to refs/heads/master by this push:
new c7a098c1b0 [fix](sql_block_rule) optimization of alter sql_block_rule
stmt (#8971)
c7a098c1b0 is described below
commit c7a098c1b0e27688aee9efc1cd7beb0c2944320b
Author: Xujian Duan <50550370+darvend...@users.noreply.github.com>
AuthorDate: Sat Apr 16 11:05:31 2022 +0800
[fix](sql_block_rule) optimization of alter sql_block_rule stmt (#8971)
Optimization of alter sql_block_rule stmt.
---
.../doris/analysis/AlterSqlBlockRuleStmt.java | 8 ++--
.../apache/doris/blockrule/SqlBlockRuleMgr.java| 16 ---
.../org/apache/doris/common/util/SqlBlockUtil.java | 17 +++
.../doris/blockrule/SqlBlockRuleMgrTest.java | 54 ++
4 files changed, 77 insertions(+), 18 deletions(-)
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/analysis/AlterSqlBlockRuleStmt.java
b/fe/fe-core/src/main/java/org/apache/doris/analysis/AlterSqlBlockRuleStmt.java
index dac0932447..cc2a13c228 100644
---
a/fe/fe-core/src/main/java/org/apache/doris/analysis/AlterSqlBlockRuleStmt.java
+++
b/fe/fe-core/src/main/java/org/apache/doris/analysis/AlterSqlBlockRuleStmt.java
@@ -34,6 +34,8 @@ import java.util.Map;
public class AlterSqlBlockRuleStmt extends DdlStmt {
+public static final Long LONG_NOT_SET = SqlBlockUtil.LONG_MINUS_ONE;
+
private final String ruleName;
private String sql;
@@ -78,9 +80,9 @@ public class AlterSqlBlockRuleStmt extends DdlStmt {
SqlBlockUtil.checkSqlAndSqlHashSetBoth(sql, sqlHash);
SqlBlockUtil.checkSqlAndLimitationsSetBoth(sql, sqlHash,
partitionNumString, tabletNumString, cardinalityString);
-this.partitionNum = Util.getLongPropertyOrDefault(partitionNumString,
0L, null, CreateSqlBlockRuleStmt.SCANNED_PARTITION_NUM + " should be a long");
-this.tabletNum = Util.getLongPropertyOrDefault(tabletNumString, 0L,
null, CreateSqlBlockRuleStmt.SCANNED_TABLET_NUM + " should be a long");
-this.cardinality = Util.getLongPropertyOrDefault(cardinalityString,
0L, null, CreateSqlBlockRuleStmt.SCANNED_CARDINALITY + " should be a long");
+this.partitionNum = Util.getLongPropertyOrDefault(partitionNumString,
LONG_NOT_SET, null, CreateSqlBlockRuleStmt.SCANNED_PARTITION_NUM + " should be
a long");
+this.tabletNum = Util.getLongPropertyOrDefault(tabletNumString,
LONG_NOT_SET, null, CreateSqlBlockRuleStmt.SCANNED_TABLET_NUM + " should be a
long");
+this.cardinality = Util.getLongPropertyOrDefault(cardinalityString,
LONG_NOT_SET, null, CreateSqlBlockRuleStmt.SCANNED_CARDINALITY + " should be a
long");
// allow null, represents no modification
String globalStr =
properties.get(CreateSqlBlockRuleStmt.GLOBAL_PROPERTY);
this.global = StringUtils.isNotEmpty(globalStr) ?
Boolean.parseBoolean(globalStr) : null;
diff --git
a/fe/fe-core/src/main/java/org/apache/doris/blockrule/SqlBlockRuleMgr.java
b/fe/fe-core/src/main/java/org/apache/doris/blockrule/SqlBlockRuleMgr.java
index ba16da9cf0..c1ddf633df 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/blockrule/SqlBlockRuleMgr.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/blockrule/SqlBlockRuleMgr.java
@@ -121,22 +121,21 @@ public class SqlBlockRuleMgr implements Writable {
if (!existRule(ruleName)) {
throw new DdlException("the sql block rule " + ruleName + "
not exist");
}
-verifyLimitations(sqlBlockRule);
SqlBlockRule originRule = nameToSqlBlockRuleMap.get(ruleName);
-SqlBlockUtil.checkAlterValidate(sqlBlockRule, originRule);
-if (StringUtils.isEmpty(sqlBlockRule.getSql())) {
+
+if
(sqlBlockRule.getSql().equals(CreateSqlBlockRuleStmt.STRING_NOT_SET)) {
sqlBlockRule.setSql(originRule.getSql());
}
-if (StringUtils.isEmpty(sqlBlockRule.getSqlHash())) {
+if
(sqlBlockRule.getSqlHash().equals(CreateSqlBlockRuleStmt.STRING_NOT_SET)) {
sqlBlockRule.setSqlHash(originRule.getSqlHash());
}
-if
(StringUtils.isEmpty(sqlBlockRule.getPartitionNum().toString())) {
+if
(sqlBlockRule.getPartitionNum().equals(AlterSqlBlockRuleStmt.LONG_NOT_SET)) {
sqlBlockRule.setPartitionNum(originRule.getPartitionNum());
}
-if (StringUtils.isEmpty(sqlBlockRule.getTabletNum().toString())) {
+if
(sqlBlockRule.getTabletNum().equals(AlterSqlBlockRuleStmt.LONG_NOT_SET)) {
sqlBlockRule.setTabletNum(originRule.getTabletNum());
}
-if (StringUtils.isEmpty(sqlBlockRule.getCardinality().toString()))
{
+if
(sqlBlockRule.getCardinality().equals(AlterSqlBlockRuleStmt.L
