[GitHub] [incubator-doris] hf200012 opened a new pull request #7797: [Doc]Doris compile and install JDK version incompatibility problem
hf200012 opened a new pull request #7797: URL: https://github.com/apache/incubator-doris/pull/7797 Doris compile and install JDK version incompatibility problem # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior: (No) 2. Has unit tests been added: (No) 3. Has document been added or modified: (No Need) 4. Does it need to update dependencies: (No) 5. Are there any changes that cannot be rolled back: (No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 opened a new pull request #7798: [Doc]Modify the audit log plugin to record the SQL statement field type as String
hf200012 opened a new pull request #7798: URL: https://github.com/apache/incubator-doris/pull/7798 Modify the audit log plugin to record the SQL statement field type as String # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior: (No) 2. Has unit tests been added: (No) 3. Has document been added or modified: (No) 4. Does it need to update dependencies: (No) 5. Are there any changes that cannot be rolled back: (No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #7797: [Doc]Doris compile and install JDK version incompatibility problem
EmmyMiao87 commented on a change in pull request #7797: URL: https://github.com/apache/incubator-doris/pull/7797#discussion_r787639773 ## File path: docs/zh-CN/faq/error.md ## @@ -145,3 +145,7 @@ failed to initialize storage reader. tablet=63416.1050661139.aa4d304e7a7aff9c-f0 有时重启 FE，会出现如上错误（通常只会出现在多 Follower 的情况下）。并且错误中的两个数值相差2。导致 FE 启动失败。 这是 bdbje 的一个 bug，尚未解决。遇到这种情况，只能通过 [元数据运维手册](../administrator-guide/operation/metadata-operation.md) 中的 故障恢复 进行操作来恢复元数据了。 + +### E12.Doris编译安装JDK版本不兼容问题 + +在自己使用Docker编译Doris的时候，编译完成安装以后启动FE，出现java.lang.Suchmethoderror: java.nio. ByteBuffer. limit (I)Ljava/nio/ByteBuffer;异常信息，这是因为Docker里默认是JDK 11，如果你的安装环境是使用JDK8 ，需要在Docker里JDK环境切换成JDK8，具体切换方法参照[编译](https://doris.apache.org/zh-CN/installing/compilation.html) Review comment: ```suggestion 在自己使用 Docker 编译 Doris 的时候，编译完成安装以后启动FE，出现 ```java.lang.Suchmethoderror: java.nio. ByteBuffer. limit (I)Ljava/nio/ByteBuffer;``` 异常信息，这是因为Docker里默认是JDK 11，如果你的安装环境是使用JDK8 ，需要在 Docker 里 JDK 环境切换成 JDK8，具体切换方法参照[编译](https://doris.apache.org/zh-CN/installing/compilation.html) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #7798: [Doc]Modify the audit log plugin to record the SQL statement field type as String
github-actions[bot] commented on pull request #7798: URL: https://github.com/apache/incubator-doris/pull/7798#issuecomment-1016357223 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #7790: [Doc] add documents for bitwise functions
EmmyMiao87 commented on a change in pull request #7790: URL: https://github.com/apache/incubator-doris/pull/7790#discussion_r787647608 ## File path: docs/en/sql-reference/sql-functions/bitwise-functions/bitand.md ## @@ -0,0 +1,57 @@ +--- Review comment: Please add document into sidebar also ~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 commented on pull request #7784: [Bug] Consider backend status when more than one backends exists in same host
EmmyMiao87 commented on pull request #7784: URL: https://github.com/apache/incubator-doris/pull/7784#issuecomment-1016362565 Please rebase your code to fix conflict ~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] i7xh commented on issue #7502: Doris Roadmap 2022
i7xh commented on issue #7502: URL: https://github.com/apache/incubator-doris/issues/7502#issuecomment-1016379365 > Provides Schemaless semantics for fast analysis of semi-structured data > Json Parsing Optimization There are a lot of user cases schema-less or semi-structured that lead to support json optimization especially，mainly with decouple change of the schema? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] i7xh commented on issue #7502: Doris Roadmap 2022
i7xh commented on issue #7502: URL: https://github.com/apache/incubator-doris/issues/7502#issuecomment-1016385262 https://user-images.githubusercontent.com/635169/150123300-5dc4c6d5-71ad-4a5f-a0d8-ba272d2ee316.png";> look forward imperatively -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] hf200012 commented on a change in pull request #7797: [Doc]Doris compile and install JDK version incompatibility problem
hf200012 commented on a change in pull request #7797: URL: https://github.com/apache/incubator-doris/pull/7797#discussion_r787664925 ## File path: docs/zh-CN/faq/error.md ## @@ -145,3 +145,7 @@ failed to initialize storage reader. tablet=63416.1050661139.aa4d304e7a7aff9c-f0 有时重启 FE，会出现如上错误（通常只会出现在多 Follower 的情况下）。并且错误中的两个数值相差2。导致 FE 启动失败。 这是 bdbje 的一个 bug，尚未解决。遇到这种情况，只能通过 [元数据运维手册](../administrator-guide/operation/metadata-operation.md) 中的 故障恢复 进行操作来恢复元数据了。 + +### E12.Doris编译安装JDK版本不兼容问题 + +在自己使用Docker编译Doris的时候，编译完成安装以后启动FE，出现java.lang.Suchmethoderror: java.nio. ByteBuffer. limit (I)Ljava/nio/ByteBuffer;异常信息，这是因为Docker里默认是JDK 11，如果你的安装环境是使用JDK8 ，需要在Docker里JDK环境切换成JDK8，具体切换方法参照[编译](https://doris.apache.org/zh-CN/installing/compilation.html) Review comment: ok -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #7790: [Doc] add documents for bitwise functions
github-actions[bot] commented on pull request #7790: URL: https://github.com/apache/incubator-doris/pull/7790#issuecomment-1016391235 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] removed a comment on pull request #7790: [Doc] add documents for bitwise functions
github-actions[bot] removed a comment on pull request #7790: URL: https://github.com/apache/incubator-doris/pull/7790#issuecomment-1016391235 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #7790: [Doc] add documents for bitwise functions
github-actions[bot] commented on pull request #7790: URL: https://github.com/apache/incubator-doris/pull/7790#issuecomment-1016395295 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #7790: [Doc] add documents for bitwise functions
github-actions[bot] commented on pull request #7790: URL: https://github.com/apache/incubator-doris/pull/7790#issuecomment-1016396516 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] HappenLee commented on pull request #7795: [Improvement](Vectorized) optimize SegmentIterator predication evaluate
HappenLee commented on pull request #7795: URL: https://github.com/apache/incubator-doris/pull/7795#issuecomment-1016430526 please move `bytes32_mask_to_bits32_mask` to util/simd/. if we SIMD code by encoding, should all be here to eazy to use in everywhere -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] HappenLee closed issue #7739: [Vectorized][Enhancement] enhancement unit test for vectorized function
HappenLee closed issue #7739: URL: https://github.com/apache/incubator-doris/issues/7739 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] HappenLee opened a new issue #7799: [Bug] Grouping Set CoreDump in TPCDS 77
HappenLee opened a new issue #7799: URL: https://github.com/apache/incubator-doris/issues/7799 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version master/vectorized ### What's Wrong? core dump ### What You Expected? get result normally ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] HappenLee opened a new pull request #7800: [Bug] Fix the bug of grouping set core in both vec and no vec query engine
HappenLee opened a new pull request #7800: URL: https://github.com/apache/incubator-doris/pull/7800 # Proposed changes Issue Number: close #7799 ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior: (Yes) 2. Has unit tests been added: (No Need) 3. Has document been added or modified: (No Need) 4. Does it need to update dependencies: (No) 5. Are there any changes that cannot be rolled back: (Yes) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] zenoyang commented on pull request #7795: [Improvement](Vectorized) optimize SegmentIterator predication evaluate
zenoyang commented on pull request #7795: URL: https://github.com/apache/incubator-doris/pull/7795#issuecomment-1016487089 > please move `bytes32_mask_to_bits32_mask` to util/simd/. if we SIMD code by encoding, should all be here to eazy to use in everywhere Done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] luzhijing commented on pull request #7797: [Doc]Doris compile and install JDK version incompatibility problem
luzhijing commented on pull request #7797: URL: https://github.com/apache/incubator-doris/pull/7797#issuecomment-1016516506 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #7674: [improvement](load) Improve load fault tolerance
github-actions[bot] commented on pull request #7674: URL: https://github.com/apache/incubator-doris/pull/7674#issuecomment-1017024811 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman merged pull request #7674: [improvement](load) Improve load fault tolerance
morningman merged pull request #7674: URL: https://github.com/apache/incubator-doris/pull/7674 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[incubator-doris] branch master updated: [improvement](load) Improve load fault tolerance (#7674)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git
The following commit(s) were added to refs/heads/master by this push:
new ef984a6 [improvement](load) Improve load fault tolerance (#7674)
ef984a6 is described below
commit ef984a6a7209f2f4fe74a29a2946f633eb02f7fd
Author: Mingyu Chen
AuthorDate: Thu Jan 20 09:23:21 2022 +0800
[improvement](load) Improve load fault tolerance (#7674)
Currently, if we encounter a problem with a replica of a tablet during the
load process,
such as a write error, rpc error, -235, etc., it will cause the entire load
job to fail,
which results in a significant reduction in Doris' fault tolerance.
This PR mainly changes:
1. refined the judgment of failed replicas in the load process, so that the
failure of a few replicas will not affect the normal completion of the load job.
2. fix a bug introduced from #7754 that may cause BE coredump
---
be/src/exec/broker_scanner.cpp | 2 +-
be/src/exec/tablet_sink.cpp| 148 +
be/src/exec/tablet_sink.h | 38 +++---
be/src/olap/delta_writer.cpp | 18 +--
be/src/olap/delta_writer.h | 4 +-
be/src/runtime/fragment_mgr.cpp| 7 +
be/src/runtime/load_channel.cpp| 15 +--
be/src/runtime/load_channel.h | 5 +-
be/src/runtime/load_channel_mgr.cpp| 7 +-
be/src/runtime/load_channel_mgr.h | 2 +-
be/src/runtime/runtime_state.h | 7 +
be/src/runtime/tablets_channel.cpp | 83 +++-
be/src/runtime/tablets_channel.h | 10 +-
be/src/service/internal_service.cpp| 3 +-
be/src/vec/sink/vtablet_sink.cpp | 2 +-
be/test/olap/delta_writer_test.cpp | 6 +-
be/test/runtime/load_channel_mgr_test.cpp | 38 +++---
.../org/apache/doris/common/proc/LoadProcDir.java | 8 +-
.../org/apache/doris/ldap/LdapAuthenticate.java| 4 +-
.../apache/doris/load/loadv2/BrokerLoadJob.java| 4 +-
.../load/loadv2/BrokerLoadingTaskAttachment.java | 10 +-
.../java/org/apache/doris/load/loadv2/LoadJob.java | 15 +++
.../apache/doris/load/loadv2/LoadLoadingTask.java | 18 +--
.../load/routineload/KafkaRoutineLoadJob.java | 2 +-
.../java/org/apache/doris/mysql/MysqlProto.java| 4 +-
.../java/org/apache/doris/qe/ConnectContext.java | 4 +
.../java/org/apache/doris/qe/ConnectProcessor.java | 13 --
.../main/java/org/apache/doris/qe/Coordinator.java | 53 +---
.../apache/doris/transaction/ErrorTabletInfo.java | 50 +++
gensrc/proto/internal_service.proto| 6 +
gensrc/script/gen_build_version.sh | 2 +-
gensrc/thrift/FrontendService.thrift | 2 +
gensrc/thrift/Types.thrift | 5 +
33 files changed, 386 insertions(+), 209 deletions(-)
diff --git a/be/src/exec/broker_scanner.cpp b/be/src/exec/broker_scanner.cpp
index ab96e6a..af44b8f 100644
--- a/be/src/exec/broker_scanner.cpp
+++ b/be/src/exec/broker_scanner.cpp
@@ -340,7 +340,7 @@ void BrokerScanner::split_line(const Slice& line) {
_split_values.emplace_back(buf, len);
}
delete row;
-delete ptr;
+delete[] ptr;
} else {
const char* value = line.data;
size_t start = 0; // point to the start pos of next col value.
diff --git a/be/src/exec/tablet_sink.cpp b/be/src/exec/tablet_sink.cpp
index 41f3570..eb018a6 100644
--- a/be/src/exec/tablet_sink.cpp
+++ b/be/src/exec/tablet_sink.cpp
@@ -42,9 +42,9 @@
namespace doris {
namespace stream_load {
-NodeChannel::NodeChannel(OlapTableSink* parent, int64_t index_id, int64_t
node_id,
+NodeChannel::NodeChannel(OlapTableSink* parent, IndexChannel* index_channel,
int64_t node_id,
int32_t schema_hash)
-: _parent(parent), _index_id(index_id), _node_id(node_id),
_schema_hash(schema_hash) {}
+: _parent(parent), _index_channel(index_channel), _node_id(node_id),
_schema_hash(schema_hash) {}
NodeChannel::~NodeChannel() {
if (_open_closure != nullptr) {
@@ -90,7 +90,7 @@ Status NodeChannel::init(RuntimeState* state) {
// Initialize _cur_add_batch_request
_cur_add_batch_request.set_allocated_id(&_parent->_load_id);
-_cur_add_batch_request.set_index_id(_index_id);
+_cur_add_batch_request.set_index_id(_index_channel->_index_id);
_cur_add_batch_request.set_sender_id(_parent->_sender_id);
_cur_add_batch_request.set_backend_id(_node_id);
_cur_add_batch_request.set_eos(false);
@@ -100,14 +100,14 @@ Status NodeChannel::init(RuntimeState* state) {
_load_info = "load_id=" + print_id(_
[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #7797: [Doc]Doris compile and install JDK version incompatibility problem
EmmyMiao87 commented on a change in pull request #7797: URL: https://github.com/apache/incubator-doris/pull/7797#discussion_r788300940 ## File path: docs/en/faq/error.md ## @@ -147,3 +147,7 @@ The second is that the packet size of rpc exceeds `max_body_size`. This problem Sometimes when restarting the Fe, the above error will occur (usually only in the case of multiple followers), and the difference between the two values in the error is 2. As a result, the Fe startup fails. This is a bug in bdbje that has not been resolved. In this case, metadata can only be recovered through fault recovery in [metadata operation and maintenance manual](../administrator-guide/operation/metadata-operation.md). + +### E12.Doris compile and install JDK version incompatibility problem + +When I use Docker to compile Doris myself, start FE after compiling and installing, java.lang.Suchmethoderror: java.nio.ByteBuffer.limit (I)Ljava/nio/ByteBuffer; exception information, this is because the default in Docker is JDK 11. If your installation environment is using JDK8, you need to switch the JDK environment to JDK8 in Docker. For the specific switching method, refer to [Compilation](https://doris.apache.org/installing/compilation.html) Review comment: ```suggestion When I use Docker to compile Doris myself, start FE after compiling and installing, ```java.lang.Suchmethoderror: java.nio.ByteBuffer.limit (I)Ljava/nio/ByteBuffer; ``` exception information, this is because the default in Docker is JDK 11. If your installation environment is using JDK8, you need to switch the JDK environment to JDK8 in Docker. For the specific switching method, refer to [Compilation](https://doris.apache.org/installing/compilation.html) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #7800: [Bug] Fix the bug of grouping set core in both vec and no vec query engine
EmmyMiao87 commented on a change in pull request #7800:
URL: https://github.com/apache/incubator-doris/pull/7800#discussion_r788306077
##
File path: fe/fe-core/src/main/java/org/apache/doris/analysis/Analyzer.java
##
@@ -722,7 +722,9 @@ public SlotDescriptor registerVirtualColumnRef(String
colName, Type type, TupleD
result = addSlotDescriptor(tupleDescriptor);
Column col = new Column(colName, type);
result.setColumn(col);
-result.setIsNullable(true);
+// now virtual slot: only use in grouping set to generate grouping id,
+// so it should always is not nullable
+result.setIsNullable(false);
Review comment:
It is better to use the `isNullable` of the column
##
File path: fe/fe-core/src/main/java/org/apache/doris/planner/RepeatNode.java
##
@@ -131,7 +131,8 @@ public void init(Analyzer analyzer) throws UserException {
// build tupleDesc according to child's tupleDesc info
outputTupleDesc = groupingInfo.getVirtualTuple();
//set aggregate nullable
-for (Expr slot : groupByClause.getGroupingExprs()) {
+for (int i = 0; i < groupByClause.getGroupingExprs().size() - 1; i++) {
Review comment:
It doesn't look like it needs to be changed?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] zuochunwei commented on pull request #7796: [Vectorized][Enhancement] SIMD fill sel_rowid_idx
zuochunwei commented on pull request #7796: URL: https://github.com/apache/incubator-doris/pull/7796#issuecomment-1017071721 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] qzsee opened a new pull request #7801: [Bug] fix vec round function
qzsee opened a new pull request #7801: URL: https://github.com/apache/incubator-doris/pull/7801 # Proposed changes reference #7421 ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior: (Yes) 2. Has unit tests been added: (No Need) 3. Has document been added or modified: (No Need) 4. Does it need to update dependencies: (No) 5. Are there any changes that cannot be rolled back: (No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] zbtzbtzbt commented on a change in pull request #7790: [Doc] add documents for bitwise functions
zbtzbtzbt commented on a change in pull request #7790: URL: https://github.com/apache/incubator-doris/pull/7790#discussion_r788315969 ## File path: docs/en/sql-reference/sql-functions/bitwise-functions/bitand.md ## @@ -0,0 +1,57 @@ +--- Review comment: done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] BiteTheDDDDt opened a new issue #7802: [Bug](Vectorized) fix get fold const value fail at datetime type
BiteThet opened a new issue #7802: URL: https://github.com/apache/incubator-doris/issues/7802 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version vectorized ### What's Wrong? Some predicate will get empty set, because of get const value fail from be. ```sql SELECT count(*) FROM lineorder_flat WHERE LO_ORDERDATE = 19930101; ``` ### What You Expected? fix it ### How to Reproduce? _No response_ ### Anything Else? _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] BiteTheDDDDt opened a new pull request #7803: [Bug](Vectorized) fix get fold const value fail at datetime type
BiteThet opened a new pull request #7803: URL: https://github.com/apache/incubator-doris/pull/7803 # Proposed changes Issue Number: close #7802 @HappenLee ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #7795: [Improvement](Vectorized) optimize SegmentIterator predication evaluate
github-actions[bot] commented on pull request #7795: URL: https://github.com/apache/incubator-doris/pull/7795#issuecomment-1017081371 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] wangbo closed pull request #7796: [Vectorized][Enhancement] SIMD fill sel_rowid_idx
wangbo closed pull request #7796: URL: https://github.com/apache/incubator-doris/pull/7796 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] HappenLee commented on a change in pull request #7800: [Bug] Fix the bug of grouping set core in both vec and no vec query engine
HappenLee commented on a change in pull request #7800:
URL: https://github.com/apache/incubator-doris/pull/7800#discussion_r788320122
##
File path: fe/fe-core/src/main/java/org/apache/doris/planner/RepeatNode.java
##
@@ -131,7 +131,8 @@ public void init(Analyzer analyzer) throws UserException {
// build tupleDesc according to child's tupleDesc info
outputTupleDesc = groupingInfo.getVirtualTuple();
//set aggregate nullable
-for (Expr slot : groupByClause.getGroupingExprs()) {
+for (int i = 0; i < groupByClause.getGroupingExprs().size() - 1; i++) {
Review comment:
The last grouping expr is virtual grouping id， not need to set nullable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #7801: [Bug] fix vec round function
github-actions[bot] commented on pull request #7801: URL: https://github.com/apache/incubator-doris/pull/7801#issuecomment-1017088651 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] wangbo closed pull request #7730: [Improvement](vectorized) optimize dict read(#7729)
wangbo closed pull request #7730: URL: https://github.com/apache/incubator-doris/pull/7730 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] yangzhg opened a new pull request #7804: [build] fix build auditlog plugin error
yangzhg opened a new pull request #7804: URL: https://github.com/apache/incubator-doris/pull/7804 # Proposed changes 1. fix problems when build fe_plugins 2. format 3. add docs about dump data using mysql dump ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] wangbo opened a new pull request #7805: optimize dict read
wangbo opened a new pull request #7805: URL: https://github.com/apache/incubator-doris/pull/7805 # Proposed changes Issue Number: close #7729 ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don't know) 2. Has unit tests been added: (Yes/No/No Need) 3. Has document been added or modified: (Yes/No/No Need) 4. Does it need to update dependencies: (Yes/No) 5. Are there any changes that cannot be rolled back: (Yes/No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #7805: [Vectorization][Enhancement]optimize dict read
github-actions[bot] commented on pull request #7805: URL: https://github.com/apache/incubator-doris/pull/7805#issuecomment-1017157859 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] xy720 commented on issue #7723: [Bug] Sometimes Fe send the fragments timeout in high concurrency scenarios
xy720 commented on issue #7723: URL: https://github.com/apache/incubator-doris/issues/7723#issuecomment-1017184341 This problem has been fixed by pr https://github.com/apache/incubator-doris/pull/6586 The reason is that the requested BackendServiceClient object has never been recycled. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman opened a new pull request #7808: [fix](schema-change) Fix bug that schema change may return -102 error
morningman opened a new pull request #7808: URL: https://github.com/apache/incubator-doris/pull/7808 # Proposed changes Issue Number: close #xxx ## Problem Summary: When using linked schema change, we need to check if all rowsets are of the same type, ALPHA or BETA. otherwise, we need to use direct schema change to convert the data. ## Checklist(Required) 1. Does it affect the original behavior: (No) 2. Has unit tests been added: (No Need) 3. Has document been added or modified: (No Need) 4. Does it need to update dependencies: (No) 5. Are there any changes that cannot be rolled back: (No) ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman opened a new issue #7809: [Bug] schema change return error -102
morningman opened a new issue #7809: URL: https://github.com/apache/incubator-doris/issues/7809 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 0.15 ### What's Wrong? when doing schema change, error in be.INFO ``` I0119 18:59:40.705777 16519 schema_change.cpp:2165] find max continuous version of tablet=15906660.1469272690.eb4c0b1025b62505-d547b605d536a6ae, start_version=107, end_version=107 W0119 18:59:40.705790 16519 beta_rowset.cpp:168] data file not existed: /premium_ssd0/307049982823895040/palobe/data/data/35/15906660/1469272690/02000221db4d5d3bb227f562d72589e3260333bf_0.dat for rowset_id: 02000221db4d5d3bb227f562d72589e3260333bf W0119 18:59:40.705806 16519 schema_change.cpp:1652] failed to alter tablet. base_tablet=15883205.1721333135.10477fb6cd881600-058248549cfd31b6, drop new_tablet=15906660.1469272690.eb4c0b1025b62505-d547b605d536a6ae I0119 18:59:40.706295 16519 schema_change.cpp:1416] finished alter tablet process, res=-102 W0119 18:59:40.706305 16519 engine_alter_tablet_task.cpp:43] failed to do alter task. res=-102 base_tablet_id=15883205, base_schema_hash=1721333135, new_tablet_id=15906660, new_schema_hash=1469272690 W0119 18:59:40.706316 16519 task_worker_pool.cpp:581] alter failed. signature: 15906660 ``` ### What You Expected? working well ### How to Reproduce? This is because the type of rowsets in a tablet are not same. Some of them are ALPHA_ROWSET, others are BETA_ROWSET. ### Anything Else? _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] github-actions[bot] commented on pull request #7803: [Bug](Vectorized) fix get fold const value fail at datetime type
github-actions[bot] commented on pull request #7803: URL: https://github.com/apache/incubator-doris/pull/7803#issuecomment-1017190469 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
[GitHub] [incubator-doris] morningman commented on pull request #7804: [build] fix build auditlog plugin error
morningman commented on pull request #7804: URL: https://github.com/apache/incubator-doris/pull/7804#issuecomment-1017204047 Please complete the PR template -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
