[GitHub] [incubator-doris] morningman merged pull request #5980: [ARRAY] Support array type load and select not include access by index

2021-07-12 Thread GitBox
morningman merged pull request #5980: URL: https://github.com/apache/incubator-doris/pull/5980 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] morningman commented on pull request #6192: ADD: support sql block rule

2021-07-12 Thread GitBox
morningman commented on pull request #6192: URL: https://github.com/apache/incubator-doris/pull/6192#issuecomment-878801096 > I think this feature is used to block some abnormal sql, for example , sql caused core. Is it need to limit the number of rules, which will occupied a lot of memory

[GitHub] [incubator-doris] morningman commented on a change in pull request #6192: ADD: support sql block rule

2021-07-12 Thread GitBox
morningman commented on a change in pull request #6192: URL: https://github.com/apache/incubator-doris/pull/6192#discussion_r668439080 ## File path: fe/fe-core/src/main/java/org/apache/doris/analysis/AlterSqlBlockRuleStmt.java ## @@ -0,0 +1,84 @@ +// Licensed to the Apache Sof

[GitHub] [incubator-doris] xinghuayu007 commented on a change in pull request #6133: [Feature]Support SELECT SQL_NO_CACHE

2021-07-12 Thread GitBox
xinghuayu007 commented on a change in pull request #6133: URL: https://github.com/apache/incubator-doris/pull/6133#discussion_r668433228 ## File path: fe/fe-core/src/main/cup/sql_parser.cup ## @@ -3509,6 +3509,11 @@ select_hints_list ::= :} ; +sql_no_cache ::= Revi

[GitHub] [incubator-doris] taoistwar opened a new issue #6218: how to build broker?

2021-07-12 Thread GitBox
taoistwar opened a new issue #6218: URL: https://github.com/apache/incubator-doris/issues/6218 ther doris verison is 0.14.0 find doc, build with: WITH_MYSQL=1 WITH_LZO=1 sh build.sh but build result not contains broker -- This is an automated message from the Ap

[GitHub] [incubator-doris] qidaye opened a new pull request #6217: [Doc][DynamicPartition] add dynamic partition creation rules

2021-07-12 Thread GitBox
qidaye opened a new pull request #6217: URL: https://github.com/apache/incubator-doris/pull/6217 ## Proposed changes optimize dynamic partition docs. ## Types of changes What types of changes does your code introduce to Doris? _Put an `x` in the boxes that apply_

[GitHub] [incubator-doris] morningman opened a new pull request #6216: [Optimize] Use flat_hash_set to replace unorderd_set in InPredicate

2021-07-12 Thread GitBox
morningman opened a new pull request #6216: URL: https://github.com/apache/incubator-doris/pull/6216 ## Proposed changes Use parallel_hashmap to speed up the In Predicate Also fix a bug that when `metadata_failure_recovery=true`, FE will not check if the IP is changed.

[incubator-doris] branch master updated: [DataX] Refactor doriswriter (#6188)

2021-07-12 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 8fe5c75 [DataX] Refactor doriswrit

[incubator-doris] branch master updated: [Doc] Fix parameter from routineLoad markdown file about ifnull (#6142)

2021-07-12 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 3cab194 [Doc] Fix parameter from r

[incubator-doris] branch master updated: [Feature] Runtime Filtering for Doris (Background, Configuration, FE Implement, Tuning, Test ) (#6121)

2021-07-12 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 394a9a1 [Feature] Runtime Filterin

[GitHub] [incubator-doris] morningman merged pull request #6188: [DataX] Refactor doriswriter

2021-07-12 Thread GitBox
morningman merged pull request #6188: URL: https://github.com/apache/incubator-doris/pull/6188 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated (d79cdc8 -> f93a272)

2021-07-12 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from d79cdc8 [Bug] Filter out unavaliable backends when getting tablet location (#6204) add f93a272 [

[GitHub] [incubator-doris] morningman merged pull request #6142: fix parameter from routineLoad md file about ifnull

2021-07-12 Thread GitBox
morningman merged pull request #6142: URL: https://github.com/apache/incubator-doris/pull/6142 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] morningman merged pull request #6121: [Feature] Runtime Filtering for Doris (FE Implement)

2021-07-12 Thread GitBox
morningman merged pull request #6121: URL: https://github.com/apache/incubator-doris/pull/6121 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] morningman merged pull request #6096: [Bug] Fix bug that nondeterministic functions should not be rewrote in create view stmt

2021-07-12 Thread GitBox
morningman merged pull request #6096: URL: https://github.com/apache/incubator-doris/pull/6096 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] morningman closed issue #6095: [Bug] The non-deterministic constant function in create view statement was rewritten

2021-07-12 Thread GitBox
morningman closed issue #6095: URL: https://github.com/apache/incubator-doris/issues/6095 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-

[incubator-doris] branch master updated: [Bug] Filter out unavaliable backends when getting tablet location (#6204)

2021-07-12 Thread wyf
This is an automated email from the ASF dual-hosted git repository. wyf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new d79cdc8 [Bug] Filter out unavaliable back

[GitHub] [incubator-doris] wuyunfeng merged pull request #6204: [Bug] Filter out unavaliable backends when getting tablet location

2021-07-12 Thread GitBox
wuyunfeng merged pull request #6204: URL: https://github.com/apache/incubator-doris/pull/6204 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: comm

[GitHub] [incubator-doris] morningman opened a new pull request #6215: [Bug][RoutineLoad] Fix bug that routine load thread on BE may be blocked

2021-07-12 Thread GitBox
morningman opened a new pull request #6215: URL: https://github.com/apache/incubator-doris/pull/6215 ## Proposed changes 1. Hold the load while shutting down the msg queue 2. Double the timeout of routine load task to avoid task abort. This bug will cause the routine load jo

[GitHub] [incubator-doris] morningman opened a new pull request #6214: [Profile] Support show load profile for broker load job

2021-07-12 Thread GitBox
morningman opened a new pull request #6214: URL: https://github.com/apache/incubator-doris/pull/6214 ## Proposed changes 1. Add new statement: `SHOW LOAD PROFILE "xxx";` Same as `SHOW QUERY PROFILE` 2. Improve the read performance of orc scanner ## Types

[GitHub] [incubator-doris] morningman opened a new pull request #6213: [Bug][RoutineLoad] Can not match whole json in routine load

2021-07-12 Thread GitBox
morningman opened a new pull request #6213: URL: https://github.com/apache/incubator-doris/pull/6213 ## Proposed changes Support using json path "$" to match the whole json in routine load ## Types of changes What types of changes does your code introduce to Doris? _P

[GitHub] [incubator-doris] morningman opened a new pull request #6211: [s3][bug] Remove log4j1

2021-07-12 Thread GitBox
morningman opened a new pull request #6211: URL: https://github.com/apache/incubator-doris/pull/6211 ## Proposed changes There are jar package conflict ## Types of changes What types of changes does your code introduce to Doris? _Put an `x` in the boxes that apply_

[GitHub] [incubator-doris] morningman opened a new pull request #6208: [Compatibility] Change the response body of load info api in httpv2.

2021-07-12 Thread GitBox
morningman opened a new pull request #6208: URL: https://github.com/apache/incubator-doris/pull/6208 ## Proposed changes To be compatible with response body of GetLoadInfoAction in httpv1. ## Types of changes What types of changes does your code introduce to Doris? _P

[GitHub] [incubator-doris] xy720 commented on a change in pull request #6096: [Bug] Fix bug that nondeterministic functions should not be rewrote in create view stmt

2021-07-12 Thread GitBox
xy720 commented on a change in pull request #6096: URL: https://github.com/apache/incubator-doris/pull/6096#discussion_r667986535 ## File path: fe/fe-core/src/main/java/org/apache/doris/analysis/CreateViewStmt.java ## @@ -63,6 +63,11 @@ public void analyze(Analyzer analyzer) t

[GitHub] [incubator-doris] liutang123 merged pull request #6023: Support alter default bucket_num of table

2021-07-12 Thread GitBox
liutang123 merged pull request #6023: URL: https://github.com/apache/incubator-doris/pull/6023 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] ucasfl edited a comment on pull request #6023: Support alter default bucket_num of table

2021-07-12 Thread GitBox
ucasfl edited a comment on pull request #6023: URL: https://github.com/apache/incubator-doris/pull/6023#issuecomment-878220226 > > Can this PR be merged? @EmmyMiao87 @morningman > > Sure, it will be merged tomorrow if there is no other comments. Looks like tomorrow has pass

[GitHub] [incubator-doris] morningman opened a new pull request #6210: [HttpV2] Add more httpv2 APIs

2021-07-12 Thread GitBox
morningman opened a new pull request #6210: URL: https://github.com/apache/incubator-doris/pull/6210 ## Proposed changes 1. /api/cluster_overview to view some statistic info of the cluster 2. /api/meta/ to view the database/table schema 3. /api/import/file_review to review the f

[GitHub] [incubator-doris] morningman opened a new pull request #6205: [Optimize] Using custom conf dir to save log config of Spring

2021-07-12 Thread GitBox
morningman opened a new pull request #6205: URL: https://github.com/apache/incubator-doris/pull/6205 ## Proposed changes The log4j-config.xml will be generated at startup of FE and also when modifying FE config. But in some deploy environment such as k8s, the conf dir is not writa

[GitHub] [incubator-doris] xy720 opened a new issue #6206: [New Feature][Meta] Add file header for image.

2021-07-12 Thread GitBox
xy720 opened a new issue #6206: URL: https://github.com/apache/incubator-doris/issues/6206 At present, our image file does not have a file header. When we need to change the image format (such as adding different journal versions to the image), there is no way to distinguish different imag

[GitHub] [incubator-doris] morningman opened a new pull request #6212: [Config] set spark load and odbc table feature enable by default

2021-07-12 Thread GitBox
morningman opened a new pull request #6212: URL: https://github.com/apache/incubator-doris/pull/6212 ## Proposed changes 1. Also use BufferedReader to speed up orc reader ## Types of changes What types of changes does your code introduce to Doris? _Put an `x` in the b

[GitHub] [incubator-doris] 13264494701 removed a comment on issue #5740: flink doris connector 支持flink 1.12吗?

2021-07-12 Thread GitBox
13264494701 removed a comment on issue #5740: URL: https://github.com/apache/incubator-doris/issues/5740#issuecomment-878159034 我之前成功编译了1.11.2版本的connector 并且运行成功 但是最近flink版本升级到了1.12.3 我重新编译成功 但是运行相同代码的时候报了如下错误 不知道是什么原因?Caused by: java.lang.ClassNotFoundException: org.apache.doris.flink.ta

[GitHub] [incubator-doris] liutang123 closed issue #6024: Support to alter default bucket_num after create table

2021-07-12 Thread GitBox
liutang123 closed issue #6024: URL: https://github.com/apache/incubator-doris/issues/6024 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-

[GitHub] [incubator-doris] morningman opened a new pull request #6209: [BDBJE] Add a tool to view the data in BEBJE

2021-07-12 Thread GitBox
morningman opened a new pull request #6209: URL: https://github.com/apache/incubator-doris/pull/6209 ## Proposed changes When the config "enable_bdbje_debug_mode" of FE is set to true, start FE and enter debug mode. In this mode, only MySQL server and http server will be started

[GitHub] [incubator-doris] xy720 commented on a change in pull request #6184: [Bug-Fix] Fix bug that show view report "Unresolved table reference" error

2021-07-12 Thread GitBox
xy720 commented on a change in pull request #6184: URL: https://github.com/apache/incubator-doris/pull/6184#discussion_r667949468 ## File path: fe/fe-core/src/main/java/org/apache/doris/analysis/ShowViewStmt.java ## @@ -114,20 +114,20 @@ public void analyze(Analyzer analyzer) t

[GitHub] [incubator-doris] ucasfl commented on pull request #6023: Support alter default bucket_num of table

2021-07-12 Thread GitBox
ucasfl commented on pull request #6023: URL: https://github.com/apache/incubator-doris/pull/6023#issuecomment-878220226 > > Can this PR be merged? @EmmyMiao87 @morningman > > Sure, it will be merged tomorrow if there is no other comments. > > Can this PR be merged? @Emm

[GitHub] [incubator-doris] 13264494701 commented on issue #5740: flink doris connector 支持flink 1.12吗?

2021-07-12 Thread GitBox
13264494701 commented on issue #5740: URL: https://github.com/apache/incubator-doris/issues/5740#issuecomment-878159034 我之前成功编译了1.11.2版本的connector 并且运行成功 但是最近flink版本升级到了1.12.3 我重新编译成功 但是运行相同代码的时候报了如下错误 不知道是什么原因?Caused by: java.lang.ClassNotFoundException: org.apache.doris.flink.table.Dori

[GitHub] [incubator-doris] xy720 opened a new pull request #6207: [New Feature][Meta][Image] Add file header for image

2021-07-12 Thread GitBox
xy720 opened a new pull request #6207: URL: https://github.com/apache/incubator-doris/pull/6207 ## Proposed changes #6206 ## Types of changes What types of changes does your code introduce to Doris? _Put an `x` in the boxes that apply_ - [x] New feature (non-b

[incubator-doris] branch master updated (dd15da4 -> 76e1489)

2021-07-12 Thread liulijia
This is an automated email from the ASF dual-hosted git repository. liulijia pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from dd15da4 [DynamicPartition] Fix UT and add more tests for dynamic partition (#6198) add 76e1489 Sup

[GitHub] [incubator-doris] BiteTheDDDDt commented on a change in pull request #6196: [Feature] Add trash_used_capacity statistics at 'show backends'

2021-07-12 Thread GitBox
BiteThet commented on a change in pull request #6196: URL: https://github.com/apache/incubator-doris/pull/6196#discussion_r667728158 ## File path: be/src/olap/storage_engine.cpp ## @@ -357,6 +357,12 @@ OLAPStatus StorageEngine::get_all_data_dir_info(vector* data_dir_in

[incubator-doris] branch master updated (56112c4 -> dd15da4)

2021-07-12 Thread yangzhg
This is an automated email from the ASF dual-hosted git repository. yangzhg pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 56112c4 [Bug] Fix bug that adding conflicting partition doesn't report errors (#6109) add dd15da4 [

[GitHub] [incubator-doris] yangzhg merged pull request #6198: [DynamicPartition] Fix UT and add more tests for dynamic partition

2021-07-12 Thread GitBox
yangzhg merged pull request #6198: URL: https://github.com/apache/incubator-doris/pull/6198 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commit

[GitHub] [incubator-doris] stdpain commented on a change in pull request #6196: [Feature] Add trash_used_capacity statistics at 'show backends'

2021-07-12 Thread GitBox
stdpain commented on a change in pull request #6196: URL: https://github.com/apache/incubator-doris/pull/6196#discussion_r667681648 ## File path: be/src/olap/storage_engine.cpp ## @@ -357,6 +357,12 @@ OLAPStatus StorageEngine::get_all_data_dir_info(vector* data_dir_in siz