[doris] branch master updated (6523b546ab -> 5ee479f45c)

2023-01-04 Thread gabriellee
This is an automated email from the ASF dual-hosted git repository. gabriellee pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 6523b546ab [chore](vulnerability) fix some high risk vulnerabilities report by bug scanner (#15621) add 5ee47

[GitHub] [doris] Gabriel39 merged pull request #15597: [Pipeline](load) Support transaction on pipeline engine

2023-01-04 Thread GitBox
Gabriel39 merged PR #15597: URL: https://github.com/apache/doris/pull/15597 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.ap

[GitHub] [doris] yiguolei commented on a diff in pull request #15624: [feature](spill to disk) Support spill to disk for sort node

2023-01-04 Thread GitBox
yiguolei commented on code in PR #15624: URL: https://github.com/apache/doris/pull/15624#discussion_r1062196061 ## be/src/vec/common/sort/sorter.cpp: ## @@ -17,48 +17,154 @@ #include "vec/common/sort/sorter.h" +#include "runtime/block_spill_manager.h" #include "runtime/thr

[GitHub] [doris] yiguolei commented on a diff in pull request #15624: [feature](spill to disk) Support spill to disk for sort node

2023-01-04 Thread GitBox
yiguolei commented on code in PR #15624: URL: https://github.com/apache/doris/pull/15624#discussion_r1062192996 ## be/src/common/config.h: ## @@ -874,6 +874,12 @@ CONF_Int32(pipeline_executor_size, "0"); // Will remove after fully test. CONF_Bool(enable_index_apply_preds_excep

[GitHub] [doris] github-actions[bot] commented on pull request #15558: [Improvement](topn) runtime prune for topn query

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15558: URL: https://github.com/apache/doris/pull/15558#issuecomment-1371887057 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] github-actions[bot] commented on pull request #15558: [Improvement](topn) runtime prune for topn query

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15558: URL: https://github.com/apache/doris/pull/15558#issuecomment-1371887029 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [doris] yiguolei commented on a diff in pull request #15624: [feature](spill to disk) Support spill to disk for sort node

2023-01-04 Thread GitBox
yiguolei commented on code in PR #15624: URL: https://github.com/apache/doris/pull/15624#discussion_r1062191883 ## be/src/vec/common/sort/sorter.cpp: ## @@ -17,48 +17,154 @@ #include "vec/common/sort/sorter.h" +#include "runtime/block_spill_manager.h" #include "runtime/thr

[GitHub] [doris] github-actions[bot] commented on a diff in pull request #15558: [Improvement](topn) runtime prune for topn query

2023-01-04 Thread GitBox
github-actions[bot] commented on code in PR #15558: URL: https://github.com/apache/doris/pull/15558#discussion_r1062189317 ## be/src/runtime/runtime_predicate.cpp: ## @@ -0,0 +1,153 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license

[GitHub] [doris] github-actions[bot] commented on pull request #15558: [Improvement](topn) runtime prune for topn query

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15558: URL: https://github.com/apache/doris/pull/15558#issuecomment-1371883225 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] github-actions[bot] commented on pull request #15558: [Improvement](topn) runtime prune for topn query

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15558: URL: https://github.com/apache/doris/pull/15558#issuecomment-1371882563 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] github-actions[bot] commented on pull request #15628: [improvement](pipeline) Support sharing hash table for broadcast join

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15628: URL: https://github.com/apache/doris/pull/15628#issuecomment-1371880931 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] yiguolei commented on a diff in pull request #15624: [feature](spill to disk) Support spill to disk for sort node

2023-01-04 Thread GitBox
yiguolei commented on code in PR #15624: URL: https://github.com/apache/doris/pull/15624#discussion_r1062186323 ## be/src/vec/common/sort/sorter.cpp: ## @@ -17,48 +17,154 @@ #include "vec/common/sort/sorter.h" +#include "runtime/block_spill_manager.h" #include "runtime/thr

[GitHub] [doris] ByteYue commented on pull request #15640: [chore](ut)add one option to skip build be when running ut

2023-01-04 Thread GitBox
ByteYue commented on PR #15640: URL: https://github.com/apache/doris/pull/15640#issuecomment-1371878365 > Would you like to provide some steps to describe the scenario you mentioned. Hi there, I was trying to deploy the ut binary from compile machine to another machine in another re

[GitHub] [doris] xiaokang commented on a diff in pull request #15558: [Improvement](topn) runtime prune for topn query

2023-01-04 Thread GitBox
xiaokang commented on code in PR #15558: URL: https://github.com/apache/doris/pull/15558#discussion_r1062184422 ## be/src/runtime/primitive_type.h: ## @@ -96,6 +96,10 @@ constexpr bool has_variable_type(PrimitiveType type) { type == TYPE_QUANTILE_STATE || type == TYP

[GitHub] [doris] yiguolei commented on a diff in pull request #15624: [feature](spill to disk) Support spill to disk for sort node

2023-01-04 Thread GitBox
yiguolei commented on code in PR #15624: URL: https://github.com/apache/doris/pull/15624#discussion_r1062145039 ## be/src/vec/common/sort/sorter.cpp: ## @@ -17,48 +17,154 @@ #include "vec/common/sort/sorter.h" +#include "runtime/block_spill_manager.h" #include "runtime/thr

[GitHub] [doris] yiguolei commented on a diff in pull request #15624: [feature](spill to disk) Support spill to disk for sort node

2023-01-04 Thread GitBox
yiguolei commented on code in PR #15624: URL: https://github.com/apache/doris/pull/15624#discussion_r1062178611 ## be/src/runtime/block_spill_manager.cpp: ## @@ -21,16 +21,28 @@ #include #include +#include "util/file_utils.h" + namespace doris { +static const std::string

[GitHub] [doris] hello-stephen commented on pull request #15639: [vulnerability](CVE-2022-1292) fix CVE-2022-1292

2023-01-04 Thread GitBox
hello-stephen commented on PR #15639: URL: https://github.com/apache/doris/pull/15639#issuecomment-1371850980 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 37.06 seconds load time: 475 seconds storage size: 17122427804 Bytes https://doris-co

[doris] branch master updated: [chore](vulnerability) fix some high risk vulnerabilities report by bug scanner (#15621)

2023-01-04 Thread yangzhg
This is an automated email from the ASF dual-hosted git repository. yangzhg pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new 6523b546ab [chore](vulnerability) fix some high

[GitHub] [doris] yangzhg merged pull request #15621: [chore](vulnerability) fix some high risk vulnerabilities report by bug scanner

2023-01-04 Thread GitBox
yangzhg merged PR #15621: URL: https://github.com/apache/doris/pull/15621 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apac

[GitHub] [doris] github-actions[bot] commented on pull request #15533: [fix](ui): 1. fix component/table can not change pageSize

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15533: URL: https://github.com/apache/doris/pull/15533#issuecomment-1371847765 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [doris] Gabriel39 commented on a diff in pull request #15558: [Improvement](topn) runtime prune for topn query

2023-01-04 Thread GitBox
Gabriel39 commented on code in PR #15558: URL: https://github.com/apache/doris/pull/15558#discussion_r1062158623 ## be/src/runtime/runtime_predicate.cpp: ## @@ -0,0 +1,153 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreement

[GitHub] [doris] Gabriel39 commented on a diff in pull request #15558: [Improvement](topn) runtime prune for topn query

2023-01-04 Thread GitBox
Gabriel39 commented on code in PR #15558: URL: https://github.com/apache/doris/pull/15558#discussion_r1062158500 ## be/src/runtime/runtime_predicate.h: ## @@ -0,0 +1,179 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements.

[GitHub] [doris] Gabriel39 commented on a diff in pull request #15558: [Improvement](topn) runtime prune for topn query

2023-01-04 Thread GitBox
Gabriel39 commented on code in PR #15558: URL: https://github.com/apache/doris/pull/15558#discussion_r1062158284 ## be/src/runtime/runtime_predicate.h: ## @@ -0,0 +1,179 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements.

[GitHub] [doris] github-actions[bot] commented on pull request #15533: [fix](ui): 1. fix component/table can not change pageSize

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15533: URL: https://github.com/apache/doris/pull/15533#issuecomment-1371846355 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] github-actions[bot] commented on pull request #15558: [Improvement](topn) runtime prune for topn query

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15558: URL: https://github.com/apache/doris/pull/15558#issuecomment-1371845486 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] Gabriel39 opened a new pull request, #15644: [Bug](decimalv3) fix wrong result for MOD operation

2023-01-04 Thread GitBox
Gabriel39 opened a new pull request, #15644: URL: https://github.com/apache/doris/pull/15644 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Y

[GitHub] [doris] github-actions[bot] commented on a diff in pull request #15642: [Enhancement](topn) support two phase read for topn query

2023-01-04 Thread GitBox
github-actions[bot] commented on code in PR #15642: URL: https://github.com/apache/doris/pull/15642#discussion_r1062156640 ## be/src/vec/exec/scan/new_olap_scan_node.cpp: ## @@ -179,13 +264,46 @@ static std::string tablets_id_to_string( return ss.str(); } +// iterate thr

[GitHub] [doris] github-actions[bot] commented on pull request #15212: [Feature](Materialized-View) support advanced Materialized-View

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15212: URL: https://github.com/apache/doris/pull/15212#issuecomment-1371844566 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] hello-stephen commented on pull request #15638: [bugfix](vertical compaction) fix dcheck failed on MOW tablet

2023-01-04 Thread GitBox
hello-stephen commented on PR #15638: URL: https://github.com/apache/doris/pull/15638#issuecomment-1371843760 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 35.84 seconds load time: 472 seconds storage size: 17122696921 Bytes https://doris-co

[GitHub] [doris] htyoung commented on pull request #15533: [fix](ui): 1. fix component/table can not change pageSize

2023-01-04 Thread GitBox
htyoung commented on PR #15533: URL: https://github.com/apache/doris/pull/15533#issuecomment-1371842633 > it mainly fix the pageSize can't be changed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [doris] htyoung commented on pull request #15533: [fix](ui): 1. fix component/table can not change pageSize

2023-01-04 Thread GitBox
htyoung commented on PR #15533: URL: https://github.com/apache/doris/pull/15533#issuecomment-1371841834 https://user-images.githubusercontent.com/9734567/210718404-6c443850-70ff-40d4-a773-b462f2c9b3b3.png";> -- This is an automated message from the Apache Git Service. To respond to the

commits@doris.apache.org

2023-01-04 Thread GitBox
XieJiann opened a new pull request, #15643: URL: https://github.com/apache/doris/pull/15643 Signed-off-by: xiejiann # Proposed changes add logical operator || && ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the

[GitHub] [doris] eldenmoon opened a new pull request, #15642: [Enhancement](topn) support two phase read for topn query

2023-01-04 Thread GitBox
eldenmoon opened a new pull request, #15642: URL: https://github.com/apache/doris/pull/15642 # Proposed changes Issue Number: close #xxx ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Y

[GitHub] [doris] yiguolei commented on a diff in pull request #15624: [feature](spill to disk) Support spill to disk for sort node

2023-01-04 Thread GitBox
yiguolei commented on code in PR #15624: URL: https://github.com/apache/doris/pull/15624#discussion_r1062145039 ## be/src/vec/common/sort/sorter.cpp: ## @@ -17,48 +17,154 @@ #include "vec/common/sort/sorter.h" +#include "runtime/block_spill_manager.h" #include "runtime/thr

[GitHub] [doris] github-actions[bot] commented on pull request #15641: [fix](macOS) Failed to run BE UT due to syscall to map cache into shared region failed

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15641: URL: https://github.com/apache/doris/pull/15641#issuecomment-1371831501 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] yiguolei commented on a diff in pull request #15624: [feature](spill to disk) Support spill to disk for sort node

2023-01-04 Thread GitBox
yiguolei commented on code in PR #15624: URL: https://github.com/apache/doris/pull/15624#discussion_r1062144227 ## be/src/vec/common/sort/sorter.cpp: ## @@ -17,48 +17,154 @@ #include "vec/common/sort/sorter.h" +#include "runtime/block_spill_manager.h" #include "runtime/thr

[GitHub] [doris] yiguolei commented on a diff in pull request #15624: [feature](spill to disk) Support spill to disk for sort node

2023-01-04 Thread GitBox
yiguolei commented on code in PR #15624: URL: https://github.com/apache/doris/pull/15624#discussion_r1062143853 ## be/src/vec/common/sort/sorter.cpp: ## @@ -17,48 +17,154 @@ #include "vec/common/sort/sorter.h" +#include "runtime/block_spill_manager.h" #include "runtime/thr

[GitHub] [doris] adonis0147 opened a new pull request, #15641: [fix](macOS) Failed to run BE UT due to syscall to map cache into shared region failed

2023-01-04 Thread GitBox
adonis0147 opened a new pull request, #15641: URL: https://github.com/apache/doris/pull/15641 # Proposed changes Issue Number: close #15637 ## Problem summary According to the post [https://developer.apple.com/forums/thread/676684](https://developer.apple.com/forums/thr

[GitHub] [doris] yiguolei commented on a diff in pull request #15624: [feature](spill to disk) Support spill to disk for sort node

2023-01-04 Thread GitBox
yiguolei commented on code in PR #15624: URL: https://github.com/apache/doris/pull/15624#discussion_r1062142518 ## be/src/common/config.h: ## @@ -874,6 +874,12 @@ CONF_Int32(pipeline_executor_size, "0"); // Will remove after fully test. CONF_Bool(enable_index_apply_preds_excep

[GitHub] [doris] HappenLee commented on a diff in pull request #15628: [improvement](pipeline) Support sharing hash table for broadcast join

2023-01-04 Thread GitBox
HappenLee commented on code in PR #15628: URL: https://github.com/apache/doris/pull/15628#discussion_r1062140788 ## be/src/runtime/fragment_mgr.cpp: ## @@ -1109,4 +1114,32 @@ Status FragmentMgr::merge_filter(const PMergeFilterRequest* request, return Status::OK(); } +vo

[GitHub] [doris] adonis0147 commented on pull request #15640: [chore](ut)add one option to skip build be when running ut

2023-01-04 Thread GitBox
adonis0147 commented on PR #15640: URL: https://github.com/apache/doris/pull/15640#issuecomment-1371825753 If we didn't modify the source code, the build for BE should be skipped by running the command `./run-be-ut.sh --run`. Would you like to provide some steps to describe the scenario you

[GitHub] [doris] hello-stephen commented on pull request #15597: [Pipeline](load) Support transaction on pipeline engine

2023-01-04 Thread GitBox
hello-stephen commented on PR #15597: URL: https://github.com/apache/doris/pull/15597#issuecomment-1371812467 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 36.04 seconds load time: 649 seconds storage size: 17122935454 Bytes https://doris-co

[GitHub] [doris] morrySnow commented on a diff in pull request #15619: [Feature](Nereids)add some scalar functions

2023-01-04 Thread GitBox
morrySnow commented on code in PR #15619: URL: https://github.com/apache/doris/pull/15619#discussion_r1062122056 ## fe/fe-core/src/main/java/org/apache/doris/catalog/FunctionSignature.java: ## @@ -113,4 +118,34 @@ public FunctionSignature varArgs(AbstractDataType...argTypes) {

[GitHub] [doris] ByteYue opened a new pull request, #15640: [chore](ut)add one option to skip build be when running ut

2023-01-04 Thread GitBox
ByteYue opened a new pull request, #15640: URL: https://github.com/apache/doris/pull/15640 # Proposed changes Issue Number: close #xxx Previously when we run be ut, it would always run building the whole binary. But sometimes I just change one conf in be.conf to test the UT, I thin

[GitHub] [doris] hello-stephen commented on pull request #15600: [DRAFT](decimalv3) test auto conversion

2023-01-04 Thread GitBox
hello-stephen commented on PR #15600: URL: https://github.com/apache/doris/pull/15600#issuecomment-1371787285 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 35.91 seconds load time: 479 seconds storage size: 17122387055 Bytes https://doris-co

[GitHub] [doris] github-actions[bot] commented on pull request #15597: [Pipeline](load) Support transaction on pipeline engine

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15597: URL: https://github.com/apache/doris/pull/15597#issuecomment-1371781534 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] github-actions[bot] commented on pull request #15621: [chore](vulnerability) fix some high risk vulnerabilities report by bug scanner

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15621: URL: https://github.com/apache/doris/pull/15621#issuecomment-1371780188 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] github-actions[bot] commented on pull request #15621: [chore](vulnerability) fix some high risk vulnerabilities report by bug scanner

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15621: URL: https://github.com/apache/doris/pull/15621#issuecomment-1371780161 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [doris] hello-stephen commented on pull request #15635: [enhancement](frontendservice) add retry when create connection to frontend service

2023-01-04 Thread GitBox
hello-stephen commented on PR #15635: URL: https://github.com/apache/doris/pull/15635#issuecomment-1371778600 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 35.52 seconds load time: 479 seconds storage size: 17123421563 Bytes https://doris-co

[GitHub] [doris] hello-stephen commented on pull request #15630: [fix](Nereids): fix bugs in conditional_function

2023-01-04 Thread GitBox
hello-stephen commented on PR #15630: URL: https://github.com/apache/doris/pull/15630#issuecomment-1371776734 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 36.46 seconds load time: 651 seconds storage size: 17122709086 Bytes https://doris-co

[GitHub] [doris] github-actions[bot] commented on pull request #15605: [improvement](projection) Improve projection performance

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15605: URL: https://github.com/apache/doris/pull/15605#issuecomment-1371763447 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] github-actions[bot] commented on a diff in pull request #15605: [improvement](projection) Improve projection performance

2023-01-04 Thread GitBox
github-actions[bot] commented on code in PR #15605: URL: https://github.com/apache/doris/pull/15605#discussion_r1062088650 ## be/src/vec/exec/join/vjoin_node_base.cpp: ## @@ -107,46 +107,46 @@ void VJoinNodeBase::_construct_mutable_join_block() { Status VJoinNodeBase::_build_

[GitHub] [doris] morrySnow commented on a diff in pull request #15595: [fix](nereids)type coercion: in-pred handle null literal bug

2023-01-04 Thread GitBox
morrySnow commented on code in PR #15595: URL: https://github.com/apache/doris/pull/15595#discussion_r1062087740 ## fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/rewrite/rules/TypeCoercion.java: ## @@ -149,7 +150,8 @@ public Expression visitInPredicate(InPre

[GitHub] [doris] github-actions[bot] commented on a diff in pull request #15597: [Pipeline](load) Support transaction on pipeline engine

2023-01-04 Thread GitBox
github-actions[bot] commented on code in PR #15597: URL: https://github.com/apache/doris/pull/15597#discussion_r1062086394 ## be/src/runtime/fragment_mgr.cpp: ## @@ -574,11 +582,16 @@ void FragmentMgr::set_pipe(const TUniqueId& fragment_instance_id, std::shared_ptr FragmentMgr

[doris] branch master updated (4f2a36f032 -> 0dfa143140)

2023-01-04 Thread morrysnow
This is an automated email from the ASF dual-hosted git repository. morrysnow pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 4f2a36f032 [project] update year in NOTICE.txt (#15632) add 0dfa143140 [enhancement](Nereids) generate colocate

[GitHub] [doris] morrySnow merged pull request #15479: [enhancement](Nereids) generate colocate join when property is different with require property

2023-01-04 Thread GitBox
morrySnow merged PR #15479: URL: https://github.com/apache/doris/pull/15479 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.ap

[GitHub] [doris] morningman commented on a diff in pull request #15612: [feature](vectorized) Support MemoryScratchSink on vectorized engine

2023-01-04 Thread GitBox
morningman commented on code in PR #15612: URL: https://github.com/apache/doris/pull/15612#discussion_r1062080335 ## be/src/util/arrow/block_convertor.cpp: ## @@ -0,0 +1,238 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreeme

[GitHub] [doris] morrySnow commented on a diff in pull request #15608: [fix](Nereids): add information function and fix bugs in schemaScan

2023-01-04 Thread GitBox
morrySnow commented on code in PR #15608: URL: https://github.com/apache/doris/pull/15608#discussion_r1062081143 ## fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/ConnectionId.java: ## @@ -0,0 +1,55 @@ +// Licensed to the Apache Software Fou

[GitHub] [doris] morningman commented on pull request #15614: [Feature](Nereids) Add hint to enable pre-aggregation when scan OLAP table.

2023-01-04 Thread GitBox
morningman commented on PR #15614: URL: https://github.com/apache/doris/pull/15614#issuecomment-1371746489 > > Why we need hint to do this? This should be set automatically by optimizer? > > This hint is supported by the old planner currently. AFAIK, people can use this hint when the

[GitHub] [doris] yangzhg opened a new pull request, #15639: [vulnerability](CVE-2022-1292) fix CVE-2022-1292

2023-01-04 Thread GitBox
yangzhg opened a new pull request, #15639: URL: https://github.com/apache/doris/pull/15639 # Proposed changes Issue Number: close #15636 ## Problem summary fix CVE-2022-1292 ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Yes

[GitHub] [doris] hello-stephen commented on pull request #15588: [Feature](add bitmap udaf) add the bitmap intersection and difference set for mixed calculation of udaf

2023-01-04 Thread GitBox
hello-stephen commented on PR #15588: URL: https://github.com/apache/doris/pull/15588#issuecomment-1371742762 TeamCity pipeline, clickbench performance test result: the sum of best hot time: 36.33 seconds load time: 649 seconds storage size: 17123449725 Bytes https://doris-co

[GitHub] [doris] github-actions[bot] commented on pull request #15638: [bugfix](vertical compaction) fix dcheck failed on MOW tablet

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15638: URL: https://github.com/apache/doris/pull/15638#issuecomment-1371742688 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] github-actions[bot] commented on pull request #15638: [bugfix](vertical compaction) fix dcheck failed on MOW tablet

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15638: URL: https://github.com/apache/doris/pull/15638#issuecomment-1371742664 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] yixiutt opened a new pull request, #15638: [bugfix](vertical compaction) fix dcheck failed in MOW tablet

2023-01-04 Thread GitBox
yixiutt opened a new pull request, #15638: URL: https://github.com/apache/doris/pull/15638 fix a dcheck error for vertical compaction on Merge-On-Write table。 When merge rowsets with empty segment, VerticalHeapMergeIterator::init return ok directly and _record_rowids not set, dcheck failed

[GitHub] [doris] github-actions[bot] commented on pull request #15479: [enhancement](Nereids) generate colocate join when property is different with require property

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15479: URL: https://github.com/apache/doris/pull/15479#issuecomment-1371741215 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [doris] github-actions[bot] commented on pull request #15479: [enhancement](Nereids) generate colocate join when property is different with require property

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15479: URL: https://github.com/apache/doris/pull/15479#issuecomment-1371741242 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] github-actions[bot] commented on pull request #15628: [improvement](pipeline) Support sharing hash table for broadcast join

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15628: URL: https://github.com/apache/doris/pull/15628#issuecomment-1371739388 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] github-actions[bot] commented on a diff in pull request #15633: [enhancement](compaction) Optimize calculating level size of input rowset in SizeBasedCumulativeCompactionPolicy

2023-01-04 Thread GitBox
github-actions[bot] commented on code in PR #15633: URL: https://github.com/apache/doris/pull/15633#discussion_r1062077020 ## be/test/olap/cumulative_compaction_policy_test.cpp: ## @@ -674,18 +674,18 @@ for (auto& rowset : rs_metas) { _tablet_meta->add_rs_meta(rows

[GitHub] [doris] github-actions[bot] commented on a diff in pull request #15597: [Pipeline](load) Support transaction on pipeline engine

2023-01-04 Thread GitBox
github-actions[bot] commented on code in PR #15597: URL: https://github.com/apache/doris/pull/15597#discussion_r1062074000 ## be/src/runtime/fragment_mgr.cpp: ## @@ -574,11 +582,21 @@ std::shared_ptr FragmentMgr::get_pipe(const TUniqueId& fragment_instance_id) { {

[GitHub] [doris] adonis0147 opened a new issue, #15637: [Bug](macOS) Failed to run BE UT

2023-01-04 Thread GitBox
adonis0147 opened a new issue, #15637: URL: https://github.com/apache/doris/issues/15637 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues. ### Version Doris Version: master

[GitHub] [doris] HappenLee commented on a diff in pull request #15597: [Pipeline](load) Support transaction on pipeline engine

2023-01-04 Thread GitBox
HappenLee commented on code in PR #15597: URL: https://github.com/apache/doris/pull/15597#discussion_r1062069760 ## be/src/runtime/fragment_mgr.cpp: ## @@ -571,14 +579,24 @@ void FragmentMgr::set_pipe(const TUniqueId& fragment_instance_id, } } -std::shared_ptr FragmentM

[GitHub] [doris] HappenLee commented on a diff in pull request #15597: [Pipeline](load) Support transaction on pipeline engine

2023-01-04 Thread GitBox
HappenLee commented on code in PR #15597: URL: https://github.com/apache/doris/pull/15597#discussion_r1062068588 ## be/src/runtime/fragment_mgr.cpp: ## @@ -571,14 +579,24 @@ void FragmentMgr::set_pipe(const TUniqueId& fragment_instance_id, } } -std::shared_ptr FragmentM

[GitHub] [doris] github-actions[bot] commented on pull request #15618: [feature-wip](multi-catalog) add fe snapshot tvf

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15618: URL: https://github.com/apache/doris/pull/15618#issuecomment-1371713833 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] LizZhang315 closed issue #13892: [Bug] [daily] be core with enable_vectorized_engine=false

2023-01-04 Thread GitBox
LizZhang315 closed issue #13892: [Bug] [daily] be core with enable_vectorized_engine=false URL: https://github.com/apache/doris/issues/13892 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [doris] github-actions[bot] commented on pull request #15635: [enhancement](frontendservice) add retry when create connection to frontend service

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15635: URL: https://github.com/apache/doris/pull/15635#issuecomment-1371710743 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] yangzhg opened a new issue, #15636: [vulnerability] openssl has CVE-2022-1292

2023-01-04 Thread GitBox
yangzhg opened a new issue, #15636: URL: https://github.com/apache/doris/issues/15636 refer detail in https://nvd.nist.gov/vuln/detail/CVE-2022-1292 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [doris] yangzhg opened a new pull request, #15635: [enhancement](frontendservice) add retry when create connection to frontend service

2023-01-04 Thread GitBox
yangzhg opened a new pull request, #15635: URL: https://github.com/apache/doris/pull/15635 # Proposed changes Issue Number: close #15634 ## Problem summary Describe your changes. ## Checklist(Required) 1. Does it affect the original behavior: - [ ] Y

[GitHub] [doris] xiaokang commented on a diff in pull request #15491: [Enhancement](point query optimize) improve performace of point query on primary keys

2023-01-04 Thread GitBox
xiaokang commented on code in PR #15491: URL: https://github.com/apache/doris/pull/15491#discussion_r1062060054 ## be/src/util/jsonb_writer.h: ## @@ -234,6 +234,17 @@ class JsonbWriterT { return 0; } +uint32_t writeInt128(__int128_t v) { +if (!stack_.

[GitHub] [doris] xiaokang commented on a diff in pull request #15491: [Enhancement](point query optimize) improve performace of point query on primary keys

2023-01-04 Thread GitBox
xiaokang commented on code in PR #15491: URL: https://github.com/apache/doris/pull/15491#discussion_r1062059550 ## be/src/util/jsonb_stream.h: ## @@ -126,6 +126,11 @@ class JsonbOutStream : public std::ostream { size_ += len; } +void write(__int128 l) { +

[GitHub] [doris] yangzhg opened a new issue, #15634: Doris be may could not connect to fe 9020 thrift server

2023-01-04 Thread GitBox
yangzhg opened a new issue, #15634: URL: https://github.com/apache/doris/issues/15634 2023-01-04 22:22:03,515 WARN (doris-mysql-nio-pool-2654|16314) [StmtExecutor.handleInsertStmt():1275] insert failed: couldn't get a client for TNetworkAddress(hostname=10.96.2.235, port=9020) org.apache

[GitHub] [doris] github-actions[bot] commented on pull request #15259: [Pipeline] Fix PipScannerContext::can_finish return wrong status

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15259: URL: https://github.com/apache/doris/pull/15259#issuecomment-1371698915 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [doris] github-actions[bot] commented on pull request #15259: [Pipeline] Fix PipScannerContext::can_finish return wrong status

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15259: URL: https://github.com/apache/doris/pull/15259#issuecomment-1371698814 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [doris] github-actions[bot] commented on pull request #15212: [Feature](Materialized-View) support advanced Materialized-View

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15212: URL: https://github.com/apache/doris/pull/15212#issuecomment-1371695869 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] XieJiann opened a new pull request, #15630: [fix](Nereids): fix bugs in conditional_function

2023-01-04 Thread GitBox
XieJiann opened a new pull request, #15630: URL: https://github.com/apache/doris/pull/15630 Signed-off-by: xiejiann # Proposed changes 1. Remove unused code when translating physicalHashJoin to avoid losing expression in physicalProject 2. Add implicit casting for arithmeti

[GitHub] [doris] wangshuo128 commented on pull request #15614: [Feature](Nereids) Add hint to enable pre-aggregation when scan OLAP table.

2023-01-04 Thread GitBox
wangshuo128 commented on PR #15614: URL: https://github.com/apache/doris/pull/15614#issuecomment-1371694611 > Why we need hint to do this? This should be set automatically by optimizer? This hint is supported by the old planner currently. AFAIK, People can use this hint when the op

[GitHub] [doris] github-actions[bot] commented on pull request #15588: [Feature](add bitmap udaf) add the bitmap intersection and difference set for mixed calculation of udaf

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15588: URL: https://github.com/apache/doris/pull/15588#issuecomment-1371690077 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] github-actions[bot] commented on a diff in pull request #15604: [refactor](scan-pool) move scan pool from env to scanner scheduler

2023-01-04 Thread GitBox
github-actions[bot] commented on code in PR #15604: URL: https://github.com/apache/doris/pull/15604#discussion_r1062052475 ## be/test/runtime/test_env.cc: ## @@ -36,7 +36,6 @@ _exec_env->_thread_mgr = new ThreadResourceMgr(2); _exec_env->_disk_io_mgr = new DiskIoMgr(1,

[doris] branch master updated (1018657d9d -> 4f2a36f032)

2023-01-04 Thread jiafengzheng
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 1018657d9d [Enhancement](SparkLoad): avoid BE OOM in push task, fix #15572 (#15620) add 4f2a36f032 [project

[GitHub] [doris] hf200012 merged pull request #15632: [project] update year in NOTICE.txt

2023-01-04 Thread GitBox
hf200012 merged PR #15632: URL: https://github.com/apache/doris/pull/15632 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

[GitHub] [doris] yiguolei commented on a diff in pull request #15624: [feature](spill to disk) Support spill to disk for sort node

2023-01-04 Thread GitBox
yiguolei commented on code in PR #15624: URL: https://github.com/apache/doris/pull/15624#discussion_r1062051965 ## be/src/common/config.h: ## @@ -874,6 +874,12 @@ CONF_Int32(pipeline_executor_size, "0"); // Will remove after fully test. CONF_Bool(enable_index_apply_preds_excep

[doris] branch master updated: [Enhancement](SparkLoad): avoid BE OOM in push task, fix #15572 (#15620)

2023-01-04 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris.git The following commit(s) were added to refs/heads/master by this push: new 1018657d9d [Enhancement](SparkLoad): avoid BE

[GitHub] [doris] morningman closed issue #15572: [Enhancement] to avoid BE OOM in spark load

2023-01-04 Thread GitBox
morningman closed issue #15572: [Enhancement] to avoid BE OOM in spark load URL: https://github.com/apache/doris/issues/15572 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [doris] morningman merged pull request #15620: [Enhancement](SparkLoad): avoid BE OOM in push task

2023-01-04 Thread GitBox
morningman merged PR #15620: URL: https://github.com/apache/doris/pull/15620 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.a

[GitHub] [doris] github-actions[bot] commented on pull request #15618: [feature-wip](multi-catalog) add fe snapshot tvf

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15618: URL: https://github.com/apache/doris/pull/15618#issuecomment-1371682457 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [doris] cambyzju merged pull request #15143: [fix](having-clause) having clause do not works correct with same alias name

2023-01-04 Thread GitBox
cambyzju merged PR #15143: URL: https://github.com/apache/doris/pull/15143 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apa

[doris] branch master updated (93f5e440eb -> 59f34be41f)

2023-01-04 Thread cambyzju
This is an automated email from the ASF dual-hosted git repository. cambyzju pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/doris.git from 93f5e440eb [Bug](execute) fix get next non stop for eos on streaming preagg (#15611) add 59f34be41f [fix](havin

[GitHub] [doris] cambyzju closed issue #15142: [Bug] having clause with same alias name do not work

2023-01-04 Thread GitBox
cambyzju closed issue #15142: [Bug] having clause with same alias name do not work URL: https://github.com/apache/doris/issues/15142 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[GitHub] [doris] XieJiann closed pull request #15630: [fix](Nereids): fix bugs in conditional_function

2023-01-04 Thread GitBox
XieJiann closed pull request #15630: [fix](Nereids): fix bugs in conditional_function URL: https://github.com/apache/doris/pull/15630 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [doris] morningman commented on a diff in pull request #15618: [feature-wip](multi-catalog) add fe snapshot tvf

2023-01-04 Thread GitBox
morningman commented on code in PR #15618: URL: https://github.com/apache/doris/pull/15618#discussion_r1062037662 ## fe/fe-core/src/main/java/org/apache/doris/tablefunction/IcebergTableValuedFunction.java: ## @@ -0,0 +1,104 @@ +// Licensed to the Apache Software Foundation (ASF)

[GitHub] [doris] github-actions[bot] commented on pull request #15621: [chore](vulnerability) fix some high risk vulnerabilities report by bug scanner

2023-01-04 Thread GitBox
github-actions[bot] commented on PR #15621: URL: https://github.com/apache/doris/pull/15621#issuecomment-1371648033 clang-tidy review says "All clean, LGTM! :+1:" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

  1   2   3   >