[GitHub] [incubator-doris] yangzhg commented on a change in pull request #6918: [Function] add bitmap function of bitmap_has_all

2021-10-25 Thread GitBox
yangzhg commented on a change in pull request #6918: URL: https://github.com/apache/incubator-doris/pull/6918#discussion_r736117280 ## File path: be/src/exprs/bitmap_function.cpp ## @@ -597,6 +597,24 @@ BooleanVal BitmapFunctions::bitmap_has_any(FunctionContext* ctx, const Str

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #6912: [Feature] add functions of bitmap_and/or_count

2021-10-25 Thread GitBox
yangzhg commented on a change in pull request #6912: URL: https://github.com/apache/incubator-doris/pull/6912#discussion_r736119084 ## File path: be/src/exprs/bitmap_function.cpp ## @@ -489,6 +489,15 @@ StringVal BitmapFunctions::bitmap_and(FunctionContext* ctx, const StringVa

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #6910: [Feature] Support bitmap_and_not & bitmap_and_not_count

2021-10-25 Thread GitBox
yangzhg commented on a change in pull request #6910: URL: https://github.com/apache/incubator-doris/pull/6910#discussion_r736120035 ## File path: docs/zh-CN/sql-reference/sql-functions/bitmap-functions/bitmap_and_not.md ## @@ -0,0 +1,48 @@ +--- +{ +"title": "bitmap_and_not

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #6910: [Feature] Support bitmap_and_not & bitmap_and_not_count

2021-10-25 Thread GitBox
yangzhg commented on a change in pull request #6910: URL: https://github.com/apache/incubator-doris/pull/6910#discussion_r736120494 ## File path: docs/zh-CN/sql-reference/sql-functions/bitmap-functions/bitmap_and_not_count.md ## @@ -0,0 +1,48 @@ +--- +{ +"title": "bitmap_a

[GitHub] [incubator-doris] morningman commented on a change in pull request #6932: fix schema change fail as memory allocation on row block sorting

2021-10-25 Thread GitBox
morningman commented on a change in pull request #6932: URL: https://github.com/apache/incubator-doris/pull/6932#discussion_r736123481 ## File path: be/src/olap/schema_change.cpp ## @@ -1184,6 +1196,16 @@ OLAPStatus SchemaChangeWithSorting::process(RowsetReaderSharedPtr rowset

[GitHub] [incubator-doris] hf200012 opened a new pull request #6933: [Doc] Use Flink CDC to realize real-time MySQL data into Apache Doris

2021-10-25 Thread GitBox
hf200012 opened a new pull request #6933: URL: https://github.com/apache/incubator-doris/pull/6933 Best Practices,Use Flink CDC to realize real-time MySQL data into Apache Doris ## Proposed changes Describe the big picture of your changes here to communicate to the mainta

[GitHub] [incubator-doris] zhangstar333 commented on a change in pull request #6912: [Feature] add functions of bitmap_and/or_count

2021-10-25 Thread GitBox
zhangstar333 commented on a change in pull request #6912: URL: https://github.com/apache/incubator-doris/pull/6912#discussion_r736162932 ## File path: be/src/exprs/bitmap_function.cpp ## @@ -489,6 +489,15 @@ StringVal BitmapFunctions::bitmap_and(FunctionContext* ctx, const Str

[GitHub] [incubator-doris] qidaye commented on a change in pull request #6917: [Function] add BE bitmap function bitmap_subset_in_range

2021-10-25 Thread GitBox
qidaye commented on a change in pull request #6917: URL: https://github.com/apache/incubator-doris/pull/6917#discussion_r736193796 ## File path: be/src/util/bitmap_value.h ## @@ -1439,6 +1439,29 @@ class BitmapValue { return ss.str(); } +/** + * Return n

[GitHub] [incubator-doris] qidaye commented on a change in pull request #6917: [Function] add BE bitmap function bitmap_subset_in_range

2021-10-25 Thread GitBox
qidaye commented on a change in pull request #6917: URL: https://github.com/apache/incubator-doris/pull/6917#discussion_r736193905 ## File path: be/src/util/bitmap_value.h ## @@ -1439,6 +1439,29 @@ class BitmapValue { return ss.str(); } +/** + * Return n

[GitHub] [incubator-doris] ZhikaiZuo opened a new pull request #6934: [Bug] Fix the error of inaccurate checking RLE page whether is full

2021-10-25 Thread GitBox
ZhikaiZuo opened a new pull request #6934: URL: https://github.com/apache/incubator-doris/pull/6934 ## Proposed changes Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature req

[GitHub] [incubator-doris] GoGoWen commented on a change in pull request #6932: fix schema change fail as memory allocation on row block sorting

2021-10-25 Thread GitBox
GoGoWen commented on a change in pull request #6932: URL: https://github.com/apache/incubator-doris/pull/6932#discussion_r736205735 ## File path: be/src/olap/schema_change.cpp ## @@ -1184,6 +1196,16 @@ OLAPStatus SchemaChangeWithSorting::process(RowsetReaderSharedPtr rowset_re

[GitHub] [incubator-doris] ZhikaiZuo opened a new pull request #6935: Fix the plain page size is too large when writing a large batch

2021-10-25 Thread GitBox
ZhikaiZuo opened a new pull request #6935: URL: https://github.com/apache/incubator-doris/pull/6935 ## Proposed changes The original code logic will save all the write data of a batch in the same plain page, which makes the seek performance bad. ## Types of changes What typ

[GitHub] [incubator-doris] fengcharles closed issue #6777: 使用kettle 导入数据时报错

2021-10-25 Thread GitBox
fengcharles closed issue #6777: URL: https://github.com/apache/incubator-doris/issues/6777 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits

[GitHub] [incubator-doris] yangzhg opened a new pull request #6920: optimize error message when using batch delete

2021-10-25 Thread GitBox
yangzhg opened a new pull request #6920: URL: https://github.com/apache/incubator-doris/pull/6920 ## Proposed changes optimize the output error message when parsing batch delete statment, hide the delete sign column ## Types of changes What types of changes does your co

[GitHub] [incubator-doris] BiteTheDDDDt opened a new issue #6921: [Bug] Runtime filter can't find fragment-id when apply_filter called early

2021-10-25 Thread GitBox
BiteThet opened a new issue #6921: URL: https://github.com/apache/incubator-doris/issues/6921 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version m

[GitHub] [incubator-doris] luzhijing opened a new pull request #6922: Update spark-doris-connector.md

2021-10-25 Thread GitBox
luzhijing opened a new pull request #6922: URL: https://github.com/apache/incubator-doris/pull/6922 ## Proposed changes Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature req

[GitHub] [incubator-doris] BiteTheDDDDt opened a new pull request #6923: [Bug] fix Runtime filter can't find fragment-id when apply_filter called early

2021-10-25 Thread GitBox
BiteThet opened a new pull request #6923: URL: https://github.com/apache/incubator-doris/pull/6923 ## Proposed changes #6921 ## Types of changes What types of changes does your code introduce to Doris? _Put an `x` in the boxes that apply_ - [X] Bugfix (non

[GitHub] [incubator-doris] morningman commented on a change in pull request #6923: [Bug] fix Runtime filter can't find fragment-id when apply_filter called early

2021-10-25 Thread GitBox
morningman commented on a change in pull request #6923: URL: https://github.com/apache/incubator-doris/pull/6923#discussion_r735497121 ## File path: be/src/runtime/fragment_mgr.cpp ## @@ -811,14 +812,21 @@ Status FragmentMgr::apply_filter(const PPublishFilterRequest* request,

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #6922: Update spark-doris-connector.md

2021-10-25 Thread GitBox
github-actions[bot] commented on pull request #6922: URL: https://github.com/apache/incubator-doris/pull/6922#issuecomment-950813775 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [incubator-doris] morningman opened a new issue #6924: [Feature] [Optimize] Disable segment cache for non-query reader

2021-10-25 Thread GitBox
morningman opened a new issue #6924: URL: https://github.com/apache/incubator-doris/issues/6924 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description

[GitHub] [incubator-doris] morningman opened a new pull request #6925: [Benchmark] Add star schema benchmark tools

2021-10-25 Thread GitBox
morningman opened a new pull request #6925: URL: https://github.com/apache/incubator-doris/pull/6925 ## Proposed changes This CL mainly changes: 1. Add star schema benchmark tools in `tools/ssb-tools`, for user to easy load and test with SSB data set. 2. Disable the segment

[GitHub] [incubator-doris] qidaye commented on a change in pull request #6917: [Function] add BE bitmap function bitmap_subset_in_range

2021-10-25 Thread GitBox
qidaye commented on a change in pull request #6917: URL: https://github.com/apache/incubator-doris/pull/6917#discussion_r735549035 ## File path: be/test/exprs/bitmap_function_test.cpp ## @@ -446,6 +446,40 @@ TEST_F(BitmapFunctionsTest, bitmap_from_string) { } } +TEST_F(

[GitHub] [incubator-doris] qidaye commented on a change in pull request #6917: [Function] add BE bitmap function bitmap_subset_in_range

2021-10-25 Thread GitBox
qidaye commented on a change in pull request #6917: URL: https://github.com/apache/incubator-doris/pull/6917#discussion_r735549144 ## File path: docs/zh-CN/sql-reference/sql-functions/bitmap-functions/bitmap_subset_in_range.md ## @@ -0,0 +1,57 @@ +--- +{ +"title": "bitmap_

[GitHub] [incubator-doris] qidaye commented on a change in pull request #6917: [Function] add BE bitmap function bitmap_subset_in_range

2021-10-25 Thread GitBox
qidaye commented on a change in pull request #6917: URL: https://github.com/apache/incubator-doris/pull/6917#discussion_r735549308 ## File path: be/src/util/bitmap_value.h ## @@ -1439,6 +1439,29 @@ class BitmapValue { return ss.str(); } +/** + * Return n

[GitHub] [incubator-doris] qidaye commented on a change in pull request #6917: [Function] add BE bitmap function bitmap_subset_in_range

2021-10-25 Thread GitBox
qidaye commented on a change in pull request #6917: URL: https://github.com/apache/incubator-doris/pull/6917#discussion_r735549416 ## File path: be/src/exprs/bitmap_function.cpp ## @@ -597,6 +597,25 @@ BooleanVal BitmapFunctions::bitmap_has_any(FunctionContext* ctx, const Stri

[GitHub] [incubator-doris] morningman opened a new issue #6926: [Bug] BE config max_segment_num_per_rowset doesn' t work

2021-10-25 Thread GitBox
morningman opened a new issue #6926: URL: https://github.com/apache/incubator-doris/issues/6926 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version tru

[GitHub] [incubator-doris] GoGoWen opened a new issue #6927: [Bug] schema change fails as memory allocation not success in row block sorting

2021-10-25 Thread GitBox
GoGoWen opened a new issue #6927: URL: https://github.com/apache/incubator-doris/issues/6927 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 0.13

[GitHub] [incubator-doris] xinyiZzz commented on pull request #6925: [Benchmark] Add star schema benchmark tools

2021-10-25 Thread GitBox
xinyiZzz commented on pull request #6925: URL: https://github.com/apache/incubator-doris/pull/6925#issuecomment-950963638 segment cache LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [incubator-doris] GoGoWen opened a new pull request #6928: add memory check before sorting

2021-10-25 Thread GitBox
GoGoWen opened a new pull request #6928: URL: https://github.com/apache/incubator-doris/pull/6928 ## Proposed changes Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature reque

[GitHub] [incubator-doris] GoGoWen closed pull request #6928: add memory check before sorting

2021-10-25 Thread GitBox
GoGoWen closed pull request #6928: URL: https://github.com/apache/incubator-doris/pull/6928 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commit

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #6920: [optimize] optimize some session variable and profile

2021-10-25 Thread GitBox
github-actions[bot] commented on pull request #6920: URL: https://github.com/apache/incubator-doris/pull/6920#issuecomment-951493456 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [incubator-doris] dh-cloud opened a new pull request #6929: add BackendHbResponse info

2021-10-25 Thread GitBox
dh-cloud opened a new pull request #6929: URL: https://github.com/apache/incubator-doris/pull/6929 when be has excepiton, fe doesn't log the BackendHbResponse info, so we can't know which be has exception the exception log is: `WARN (heartbeat mgr|31) [HeartbeatMgr.runAfterCatalog

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #6929: add BackendHbResponse info

2021-10-25 Thread GitBox
github-actions[bot] commented on pull request #6929: URL: https://github.com/apache/incubator-doris/pull/6929#issuecomment-951498960 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #6923: [Bug] fix Runtime filter can't find fragment-id when apply_filter called early

2021-10-25 Thread GitBox
github-actions[bot] commented on pull request #6923: URL: https://github.com/apache/incubator-doris/pull/6923#issuecomment-951499284 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #6919: [Bug] Fix treat tuple_is_null_predicate is const expr cause core problem

2021-10-25 Thread GitBox
github-actions[bot] commented on pull request #6919: URL: https://github.com/apache/incubator-doris/pull/6919#issuecomment-951499482 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [incubator-doris] GoGoWen opened a new pull request #6932: fix schema change fail as memory allocation on row block sorting

2021-10-25 Thread GitBox
GoGoWen opened a new pull request #6932: URL: https://github.com/apache/incubator-doris/pull/6932 ## Proposed changes schema change fail as memory allocation fail on row block sorting, however, it should do internal sorting first before schema change fail as memory allocation fail on r

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #6925: [Benchmark] Add star schema benchmark tools

2021-10-25 Thread GitBox
yangzhg commented on a change in pull request #6925: URL: https://github.com/apache/incubator-doris/pull/6925#discussion_r736105562 ## File path: be/src/exec/tablet_sink.h ## @@ -191,15 +192,20 @@ class NodeChannel { } int64_t node_id() const { return _node_id; } -

[GitHub] [incubator-doris] morningman commented on a change in pull request #6925: [Benchmark] Add star schema benchmark tools

2021-10-25 Thread GitBox
morningman commented on a change in pull request #6925: URL: https://github.com/apache/incubator-doris/pull/6925#discussion_r736111823 ## File path: tools/ssb-tools/doris-cluster.conf ## @@ -0,0 +1,27 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more c

[GitHub] [incubator-doris] chovy-3012 closed pull request #6877: [Optimize] add err msg and err type in audit event

2021-10-25 Thread GitBox
chovy-3012 closed pull request #6877: URL: https://github.com/apache/incubator-doris/pull/6877 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #6917: [Function] add BE bitmap function bitmap_subset_in_range

2021-10-25 Thread GitBox
yangzhg commented on a change in pull request #6917: URL: https://github.com/apache/incubator-doris/pull/6917#discussion_r736113793 ## File path: be/src/util/bitmap_value.h ## @@ -1439,6 +1439,29 @@ class BitmapValue { return ss.str(); } +/** + * Return