[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #7255: [feat](lateral-view) Support execution of lateral view stmt

2021-12-09 Thread GitBox
EmmyMiao87 commented on a change in pull request #7255: URL: https://github.com/apache/incubator-doris/pull/7255#discussion_r765505365 ## File path: be/src/exec/table_function_node.cpp ## @@ -0,0 +1,341 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or mo

[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #7198: [Memory] Use TCMalloc Hook to count the real Process and Query MemTracker

2021-12-09 Thread GitBox
EmmyMiao87 commented on a change in pull request #7198: URL: https://github.com/apache/incubator-doris/pull/7198#discussion_r765548980 ## File path: be/src/common/config.h ## @@ -601,6 +604,12 @@ CONF_mInt32(remote_storage_read_buffer_mb, "16"); // the level equal or lower tha

[GitHub] [incubator-doris] jackwener closed issue #7343: [Proposal] Add module label for issue and PR

2021-12-09 Thread GitBox
jackwener closed issue #7343: URL: https://github.com/apache/incubator-doris/issues/7343 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-u

[GitHub] [incubator-doris] jackwener closed issue #7243: [Enhancement] Add document of storage engine

2021-12-09 Thread GitBox
jackwener closed issue #7243: URL: https://github.com/apache/incubator-doris/issues/7243 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-u

[GitHub] [incubator-doris] EmmyMiao87 commented on pull request #7357: feature: InferPredicate#7096

2021-12-09 Thread GitBox
EmmyMiao87 commented on pull request #7357: URL: https://github.com/apache/incubator-doris/pull/7357#issuecomment-989663991 Please change your PR title and msg by https://doris.apache.org/master/zh-CN/developer-guide/commit-format-specification.html#commit-%E6%A0%BC%E5%BC%8F%E8%A7%84%E8%8C%

[GitHub] [incubator-doris] jackwener opened a new pull request #7360: [fix] skip the condition of null

2021-12-09 Thread GitBox
jackwener opened a new pull request #7360: URL: https://github.com/apache/incubator-doris/pull/7360 ## Proposed changes Close related #7355 when entry is null, there will be `NullPointerException`. ## Types of changes What types of changes does your code introduc

[GitHub] [incubator-doris] tinkerrrr opened a new issue #7361: [Bug] Mv rewrite bug may cause SQL failure

2021-12-09 Thread GitBox
tinke opened a new issue #7361: URL: https://github.com/apache/incubator-doris/issues/7361 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version trun

[GitHub] [incubator-doris] jackwener commented on a change in pull request #7360: [fix] skip the condition of null

2021-12-09 Thread GitBox
jackwener commented on a change in pull request #7360: URL: https://github.com/apache/incubator-doris/pull/7360#discussion_r765586193 ## File path: fe/fe-core/src/main/java/org/apache/doris/analysis/InsertStmt.java ## @@ -604,9 +604,7 @@ private void analyzeRow(Analyzer analyze

[GitHub] [incubator-doris] tinkerrrr opened a new pull request #7362: Fix mv rewrite bug

2021-12-09 Thread GitBox
tinke opened a new pull request #7362: URL: https://github.com/apache/incubator-doris/pull/7362 ## Proposed changes Close related [#7361](https://github.com/apache/incubator-doris/issues/7361) Describe the overview of changes, and introduce why we need it. ## Types o

[GitHub] [incubator-doris] JNSimba commented on pull request #7210: [feat](flink-connector) add BATCH DELETE support

2021-12-09 Thread GitBox
JNSimba commented on pull request #7210: URL: https://github.com/apache/incubator-doris/pull/7210#issuecomment-989718341 > 3. Batch delete: `merge_type: DELETE` is a good method for delete. If there are two records in a batch : one is delete and the other is append, `merge_type: MERGE` can

[GitHub] [incubator-doris] JNSimba commented on pull request #7210: [feat](flink-connector) add BATCH DELETE support

2021-12-09 Thread GitBox
JNSimba commented on pull request #7210: URL: https://github.com/apache/incubator-doris/pull/7210#issuecomment-989727488 > > 3. Batch delete: `merge_type: DELETE` is a good method for delete. If there are two records in a batch : one is delete and the other is append, `merge_type: MERGE` c

[GitHub] [incubator-doris] JNSimba edited a comment on pull request #7210: [feat](flink-connector) add BATCH DELETE support

2021-12-09 Thread GitBox
JNSimba edited a comment on pull request #7210: URL: https://github.com/apache/incubator-doris/pull/7210#issuecomment-989718341 > 3. Batch delete: `merge_type: DELETE` is a good method for delete. If there are two records in a batch : one is delete and the other is append, `merge_type: MER

[GitHub] [incubator-doris] JNSimba edited a comment on pull request #7210: [feat](flink-connector) add BATCH DELETE support

2021-12-09 Thread GitBox
JNSimba edited a comment on pull request #7210: URL: https://github.com/apache/incubator-doris/pull/7210#issuecomment-989718341 > 3. Batch delete: `merge_type: DELETE` is a good method for delete. If there are two records in a batch : one is delete and the other is append, `merge_type: MER

[GitHub] [incubator-doris] GoGoWen commented on pull request #7293: improve memory usage for broker load

2021-12-09 Thread GitBox
GoGoWen commented on pull request #7293: URL: https://github.com/apache/incubator-doris/pull/7293#issuecomment-989735008 > > better to do a test to see the performance decrease than before. > > Yes, would you like to make a simple test for this case? sure, i will test this

[GitHub] [incubator-doris] yx91490 commented on a change in pull request #7309: [Document] Improve the chapter on debugging FE in doc.

2021-12-09 Thread GitBox
yx91490 commented on a change in pull request #7309: URL: https://github.com/apache/incubator-doris/pull/7309#discussion_r765679590 ## File path: docs/zh-CN/developer-guide/fe-idea-dev.md ## @@ -37,24 +37,37 @@ JDK1.8+, IntelliJ IDEA 3. 如果仅进行fe开发而没有编译过thirdparty,则需要安装thrift,并将

[GitHub] [incubator-doris] lordk911 opened a new issue #7363: [Bug] Spark Doris Connector build faild with spark3

2021-12-09 Thread GitBox
lordk911 opened a new issue #7363: URL: https://github.com/apache/incubator-doris/issues/7363 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version apach

[GitHub] [incubator-doris] whutpencil commented on a change in pull request #7309: [Document] Improve the chapter on debugging FE in doc.

2021-12-09 Thread GitBox
whutpencil commented on a change in pull request #7309: URL: https://github.com/apache/incubator-doris/pull/7309#discussion_r765745882 ## File path: docs/zh-CN/developer-guide/fe-idea-dev.md ## @@ -37,24 +37,37 @@ JDK1.8+, IntelliJ IDEA 3. 如果仅进行fe开发而没有编译过thirdparty,则需要安装thrift

[GitHub] [incubator-doris] morningman merged pull request #7283: [improvement](compaction)(tablet repair) Add missing rowsets in compaction status url and support force dropping redundant replica

2021-12-09 Thread GitBox
morningman merged pull request #7283: URL: https://github.com/apache/incubator-doris/pull/7283 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated: [improvement](compaction)(tablet repair) Add missing rowsets in compaction status url and support force dropping redundant replica (#7283)

2021-12-09 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new db57c42 [improvement](compaction)(

[incubator-doris] branch master updated: [refactor] modify the control flow code to improve code readability (#7302)

2021-12-09 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new ac739fe [refactor] modify the cont

[GitHub] [incubator-doris] morningman merged pull request #7302: [refactor] modify the control flow code to improve code readability

2021-12-09 Thread GitBox
morningman merged pull request #7302: URL: https://github.com/apache/incubator-doris/pull/7302 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated: [refactor] modify the implements of Tuple & RowBatch (#7319)

2021-12-09 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 80c11da [refactor] modify the impl

[GitHub] [incubator-doris] morningman merged pull request #7319: [refactor] modify the implements of tuple & RowBatch

2021-12-09 Thread GitBox
morningman merged pull request #7319: URL: https://github.com/apache/incubator-doris/pull/7319 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] DouglasJun commented on issue #7246: couldn't deserialize thrift msg

2021-12-09 Thread GitBox
DouglasJun commented on issue #7246: URL: https://github.com/apache/incubator-doris/issues/7246#issuecomment-990466736 You shuold check your fe's version is matching with your be's version(fe and be is running) -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-doris] hf200012 opened a new pull request #7364: upgrade log4j

2021-12-09 Thread GitBox
hf200012 opened a new pull request #7364: URL: https://github.com/apache/incubator-doris/pull/7364 upgrade log4j Upgrade Log4j to version 2.15.0 to solve remote execution vulnerabilities ## Proposed changes Close related #issue (replace it with issue number if it exists).

[GitHub] [incubator-doris] lordk911 commented on pull request #6956: [Improve] Spark connector supports multiple spark versions:2.1.x/2.3.x/3.x

2021-12-09 Thread GitBox
lordk911 commented on pull request #6956: URL: https://github.com/apache/incubator-doris/pull/6956#issuecomment-990553323 https://github.com/apache/incubator-doris/issues/7363 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [incubator-doris] lordk911 commented on issue #7363: [Bug] Spark Doris Connector build faild with spark3

2021-12-09 Thread GitBox
lordk911 commented on issue #7363: URL: https://github.com/apache/incubator-doris/issues/7363#issuecomment-990553883 v2 package is not in spark3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [incubator-doris] lordk911 commented on issue #6806: Release note 0.15.0

2021-12-09 Thread GitBox
lordk911 commented on issue #6806: URL: https://github.com/apache/incubator-doris/issues/6806#issuecomment-990555242 Spark Doris Connector build faild with spark3 https://github.com/apache/incubator-doris/issues/7363 -- This is an automated message from the Apache Git Service. To respon

[GitHub] [incubator-doris] caoliang-web commented on issue #6806: Release note 0.15.0

2021-12-09 Thread GitBox
caoliang-web commented on issue #6806: URL: https://github.com/apache/incubator-doris/issues/6806#issuecomment-99021 这是来自QQ邮箱的假期自动回复邮件。你好,我最近正在休假中,无法亲自回复你的邮件。我将在假期结束后,尽快给你回复。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [incubator-doris] chovy-3012 commented on issue #7363: [Bug] Spark Doris Connector build faild with spark3

2021-12-09 Thread GitBox
chovy-3012 commented on issue #7363: URL: https://github.com/apache/incubator-doris/issues/7363#issuecomment-990566477 > v2 package is not in spark3 Which verison of the source code do you buiild ? I just checked the latest release version `0.15.0-rc04` , PR #6956 was't merg

[GitHub] [incubator-doris] lordk911 commented on issue #7363: [Bug] Spark Doris Connector build faild with spark3

2021-12-09 Thread GitBox
lordk911 commented on issue #7363: URL: https://github.com/apache/incubator-doris/issues/7363#issuecomment-990570146 > > v2 package is not in spark3 > > Which verison of the source code do you buiild ? > > I just checked the latest release version `0.15.0-rc04` , PR #6956 was'

[GitHub] [incubator-doris] whutpencil opened a new issue #7365: [Bug] The Load job will get stuck without any progress, then report timeout and abort.

2021-12-09 Thread GitBox
whutpencil opened a new issue #7365: URL: https://github.com/apache/incubator-doris/issues/7365 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 0.1

[GitHub] [incubator-doris] sodamnsure opened a new issue #7366: [Bug] DataX doriswriter 解析csv遇到包含换行字符的字段报错

2021-12-09 Thread GitBox
sodamnsure opened a new issue #7366: URL: https://github.com/apache/incubator-doris/issues/7366 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 0.1

[GitHub] [incubator-doris] zbtzbtzbt commented on pull request #7364: upgrade log4j

2021-12-09 Thread GitBox
zbtzbtzbt commented on pull request #7364: URL: https://github.com/apache/incubator-doris/pull/7364#issuecomment-990608409 The bug is belong to apache Log4j 2, not Log4j. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [incubator-doris] tinkerrrr commented on pull request #7364: upgrade log4j

2021-12-09 Thread GitBox
tinke commented on pull request #7364: URL: https://github.com/apache/incubator-doris/pull/7364#issuecomment-990619853 Module `fe_plugins` and `apache_hdfs_broker` should upgrade too. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] hf200012 commented on pull request #7364: upgrade log4j

2021-12-09 Thread GitBox
hf200012 commented on pull request #7364: URL: https://github.com/apache/incubator-doris/pull/7364#issuecomment-990621590 > The bug is belong to apache Log4j 2, not Log4j. We are using this org.apache.logging.log4j > The bug is belong to apache Log4j 2, not Log4j. We

[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #7357: [feature] (planner) InferPredicate (#7096)

2021-12-09 Thread GitBox
EmmyMiao87 commented on a change in pull request #7357: URL: https://github.com/apache/incubator-doris/pull/7357#discussion_r765707119 ## File path: fe/fe-core/src/main/java/org/apache/doris/rewrite/InferFiltersRule.java ## @@ -0,0 +1,302 @@ +// Licensed to the Apache Software

[GitHub] [incubator-doris] tinkerrrr closed issue #7344: [Bug] 0.14 FE can't read 0.15 FE's metadata

2021-12-09 Thread GitBox
tinke closed issue #7344: URL: https://github.com/apache/incubator-doris/issues/7344 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-u

[GitHub] [incubator-doris] aihai commented on pull request #7210: [feat](flink-connector) add BATCH DELETE support

2021-12-09 Thread GitBox
aihai commented on pull request #7210: URL: https://github.com/apache/incubator-doris/pull/7210#issuecomment-990707046 Thank you very much, it works. It is what I wanted. Another question, how about the flink sink only supports `json` format? The `Doris Sink` and `DorisDynamic

[GitHub] [incubator-doris] lordk911 commented on issue #5635: Doris 0.14.7 version, there is a backlog of stream load tasks

2021-12-09 Thread GitBox
lordk911 commented on issue #5635: URL: https://github.com/apache/incubator-doris/issues/5635#issuecomment-990708203 so how to limit stream load task to avoid exceed the FE limit ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi