[GitHub] [incubator-doris] zuochunwei commented on pull request #6971: hll optimize: trace memory usage, new explicit data when really need

2021-11-01 Thread GitBox
zuochunwei commented on pull request #6971: URL: https://github.com/apache/incubator-doris/pull/6971#issuecomment-955984076 > Hi @zuochunwei Could you please create an issue to describe more detail about how this works and how much memory can be reduced after this PR? each HLL object

[GitHub] [incubator-doris] yangzhg opened a new issue #6978: [Feature] Limit Doris's memory usage more accurately and reduce the occurrence of OOM

2021-11-01 Thread GitBox
yangzhg opened a new issue #6978: URL: https://github.com/apache/incubator-doris/issues/6978 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description Cu

[GitHub] [incubator-doris] yangzhg opened a new pull request #6979: Add a method to get doris current memory usage

2021-11-01 Thread GitBox
yangzhg opened a new pull request #6979: URL: https://github.com/apache/incubator-doris/pull/6979 ## Proposed changes Add a method to get Doris current memory usage, get Doris memory usage every 1 second. This method used to limit the whole memory allocation in Doris Add all me

[GitHub] [incubator-doris] pengxiangyu opened a new pull request #6980: [Function] Add bitmap function bitmap_subset_limit

2021-11-01 Thread GitBox
pengxiangyu opened a new pull request #6980: URL: https://github.com/apache/incubator-doris/pull/6980 ## Proposed changes Add bitmap function bitmap_subset_limit. This function will return subset in specified index. ## Types of changes What types of changes does your

[GitHub] [incubator-doris] ans76 commented on a change in pull request #6979: [Memory] Add a method to get doris current memory usage and Limt memoey usage when consume

2021-11-01 Thread GitBox
ans76 commented on a change in pull request #6979: URL: https://github.com/apache/incubator-doris/pull/6979#discussion_r740057690 ## File path: be/src/common/config.h ## @@ -639,6 +639,9 @@ CONF_mInt32(external_table_connect_timeout_sec, "5"); // So the value of this config sh

[GitHub] [incubator-doris] ans76 commented on a change in pull request #6979: [Memory] Add a method to get doris current memory usage and Limt memoey usage when consume

2021-11-01 Thread GitBox
ans76 commented on a change in pull request #6979: URL: https://github.com/apache/incubator-doris/pull/6979#discussion_r740071851 ## File path: be/src/runtime/mem_tracker.h ## @@ -170,6 +172,12 @@ class MemTracker : public std::enable_shared_from_this { Release(-b

[GitHub] [incubator-doris] xy720 opened a new issue #6981: [Feature] [Bitmap-Function] Add bitmap-xor-count function for doris

2021-11-01 Thread GitBox
xy720 opened a new issue #6981: URL: https://github.com/apache/incubator-doris/issues/6981 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description Add

[GitHub] [incubator-doris] xy720 opened a new pull request #6982: [BitMap-Function] Add bitmap-xor-count function for doris

2021-11-01 Thread GitBox
xy720 opened a new pull request #6982: URL: https://github.com/apache/incubator-doris/pull/6982 ## Proposed changes Add bitmap-xor-count function for doris ## Types of changes What types of changes does your code introduce to Doris? _Put an `x` in the boxes that apply

[GitHub] [incubator-doris] morningman opened a new issue #6983: [Bug] Spark and Flink connector need ADMIN_PRIV to get backends list

2021-11-01 Thread GitBox
morningman opened a new issue #6983: URL: https://github.com/apache/incubator-doris/issues/6983 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 0.1

[GitHub] [incubator-doris] morningman opened a new pull request #6984: [HTTP][API] Add backends info API for spark/flink connector

2021-11-01 Thread GitBox
morningman opened a new pull request #6984: URL: https://github.com/apache/incubator-doris/pull/6984 ## Proposed changes Doris should provide a http api to return backends list for connectors to submit stream load, and without privilege checking, which can let common user to use i

[GitHub] [incubator-doris] morningman commented on a change in pull request #6977: [Function] add BE bitmap function sub_bitmap

2021-11-01 Thread GitBox
morningman commented on a change in pull request #6977: URL: https://github.com/apache/incubator-doris/pull/6977#discussion_r740308333 ## File path: be/src/exprs/bitmap_function.h ## @@ -99,6 +99,8 @@ class BitmapFunctions { static BigIntVal bitmap_max(FunctionContext* ctx

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #6982: [BitMap-Function] Add bitmap-xor-count function for doris

2021-11-01 Thread GitBox
github-actions[bot] commented on pull request #6982: URL: https://github.com/apache/incubator-doris/pull/6982#issuecomment-956351254 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [incubator-doris] xinyiZzz commented on a change in pull request #6977: [Function] add BE bitmap function sub_bitmap

2021-11-01 Thread GitBox
xinyiZzz commented on a change in pull request #6977: URL: https://github.com/apache/incubator-doris/pull/6977#discussion_r740326776 ## File path: be/src/exprs/bitmap_function.h ## @@ -99,6 +99,8 @@ class BitmapFunctions { static BigIntVal bitmap_max(FunctionContext* ctx,

[GitHub] [incubator-doris] morningman opened a new issue #6985: [Feature] [RoutineLoad] Show current running transaction of a routine load job

2021-11-01 Thread GitBox
morningman opened a new issue #6985: URL: https://github.com/apache/incubator-doris/issues/6985 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description

[GitHub] [incubator-doris] morningman opened a new pull request #6986: fix bug

2021-11-01 Thread GitBox
morningman opened a new pull request #6986: URL: https://github.com/apache/incubator-doris/pull/6986 ## Proposed changes Add a new field `runningTxns` in the result of `SHOW ROUTINE LOAD`. eg: ``` Id: 11001 Name: test4 Create

[GitHub] [incubator-doris] ans76 commented on a change in pull request #6979: [Memory] Add a method to get doris current memory usage and Limt memoey usage when consume

2021-11-01 Thread GitBox
ans76 commented on a change in pull request #6979: URL: https://github.com/apache/incubator-doris/pull/6979#discussion_r740071851 ## File path: be/src/runtime/mem_tracker.h ## @@ -170,6 +172,12 @@ class MemTracker : public std::enable_shared_from_this { Release(-b

[GitHub] [incubator-doris] zuochunwei opened a new pull request #6988: mem_tracker optimization

2021-11-01 Thread GitBox
zuochunwei opened a new pull request #6988: URL: https://github.com/apache/incubator-doris/pull/6988 optimise HighWaterMarkCounter::add(), UpdateMax only if delta greate than 0 to reduce function call times delete useless code lines to keep MemTrack clean -- This is an automated mess

[GitHub] [incubator-doris] archongum commented on issue #5011: Does doris have an official performance evaluation tool?

2021-11-01 Thread GitBox
archongum commented on issue #5011: URL: https://github.com/apache/incubator-doris/issues/5011#issuecomment-957097384 > Configuration sys_log_verbose_modules is the main reason affecting performance, close issue. @ZhaoBQ Please share your configurations if possible. -- This is an

[GitHub] [incubator-doris] morningman commented on issue #5011: Does doris have an official performance evaluation tool?

2021-11-01 Thread GitBox
morningman commented on issue #5011: URL: https://github.com/apache/incubator-doris/issues/5011#issuecomment-957097935 This issue is out of date. Please refer to `http://doris.incubator.apache.org/master/zh-CN/best-practices/star-schema-benchmark.html` -- This is an automated message fr

[GitHub] [incubator-doris] Userwhite opened a new issue #6989: [Feature] DorisOnEs support Aggregate push down

2021-11-01 Thread GitBox
Userwhite opened a new issue #6989: URL: https://github.com/apache/incubator-doris/issues/6989 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description

[GitHub] [incubator-doris] Userwhite opened a new pull request #6990: Doris on es

2021-11-01 Thread GitBox
Userwhite opened a new pull request #6990: URL: https://github.com/apache/incubator-doris/pull/6990 ## Proposed changes support pushdown aggregate operator to ES https://github.com/apache/incubator-doris/issues/6989 ## Types of changes What types of changes does

[GitHub] [incubator-doris] hf200012 opened a new issue #6991: [Bug] Error executing insert into select

2021-11-01 Thread GitBox
hf200012 opened a new issue #6991: URL: https://github.com/apache/incubator-doris/issues/6991 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 0.14.

[GitHub] [incubator-doris] hf200012 commented on issue #6991: [Bug] Error executing insert into select

2021-11-01 Thread GitBox
hf200012 commented on issue #6991: URL: https://github.com/apache/incubator-doris/issues/6991#issuecomment-957145361 After failure, be must be restarted to execute successfully -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [incubator-doris] hf200012 commented on issue #6991: [Bug] Error executing insert into select

2021-11-01 Thread GitBox
hf200012 commented on issue #6991: URL: https://github.com/apache/incubator-doris/issues/6991#issuecomment-957146456 Only execute this sql without executing the insert operation. There is no problem for 30 consecutive executions. The amount of data returned by this sql is less than 2000 p