[incubator-doris] branch master updated (9a0a1c6 -> 4335c07)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 9a0a1c6 [fix] fix NPE in thrift when forwarding stmt to master FE add 4335c07 [doc] update star-s

[incubator-doris] branch master updated (be3d203 -> 9a0a1c6)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from be3d203 [feature][vectorized] support table function explode_numbers() (#8509) add 9a0a1c6 [fix]

[GitHub] [incubator-doris] morningman commented on pull request #8575: [feature-wip](array-type) Create table with nested array type.

2022-03-22 Thread GitBox
morningman commented on pull request #8575: URL: https://github.com/apache/incubator-doris/pull/8575#issuecomment-1074806527 This PR is moved from array-type branch, I will merge it now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8575: [feature-wip](array-type) Create table with nested array type.

2022-03-22 Thread GitBox
github-actions[bot] commented on pull request #8575: URL: https://github.com/apache/incubator-doris/pull/8575#issuecomment-1074806632 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-doris] morningman edited a comment on pull request #8575: [feature-wip](array-type) Create table with nested array type.

2022-03-22 Thread GitBox
morningman edited a comment on pull request #8575: URL: https://github.com/apache/incubator-doris/pull/8575#issuecomment-1074806527 This PR is moved from array-type branch, which has been reviewed befreo. I will merge it now. -- This is an automated message from the Apache Git Service. T

[GitHub] [incubator-doris] morningman merged pull request #8575: [feature-wip](array-type) Create table with nested array type.

2022-03-22 Thread GitBox
morningman merged pull request #8575: URL: https://github.com/apache/incubator-doris/pull/8575 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] adonis0147 opened a new pull request #8582: [feature-wip][array-type] Support ArrayLiteral in SQL.

2022-03-22 Thread GitBox
adonis0147 opened a new pull request #8582: URL: https://github.com/apache/incubator-doris/pull/8582 # Proposed changes Issue Number: close #8074 . ## Problem Summary: Please refer to #8074 . ## Checklist(Required) 1. Does it affect the original behavior: N

[GitHub] [incubator-doris] yym12 opened a new issue #8583: doris同步canal的binlog数据 过滤字段

2022-03-22 Thread GitBox
yym12 opened a new issue #8583: URL: https://github.com/apache/incubator-doris/issues/8583 如果我的源表有很多字段是目标表用不到的 需要写很多空行在里面吗? ![image](https://user-images.githubusercontent.com/41983444/159426359-f79d627f-0a98-4912-ba4b-9daaf39068c6.png) -- This is an automated message from the Ap

[GitHub] [incubator-doris] morningman merged pull request #8582: [feature-wip][array-type] Support ArrayLiteral in SQL.

2022-03-22 Thread GitBox
morningman merged pull request #8582: URL: https://github.com/apache/incubator-doris/pull/8582 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated (106d7c2 -> cf0a9fd)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 106d7c2 [fix] Wrong conf be used for Filesytem in S3Storage (#8568) add cf0a9fd [feature-wip](arr

[incubator-doris] branch master updated (cf0a9fd -> 38ec3cb)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from cf0a9fd [feature-wip](array-type) Create table with nested array type. (#8003) (#8575) add 38ec3c

[GitHub] [incubator-doris] cambyzju opened a new pull request #8584: [feature-wip](array-type)support select ARRAY data type on vectorized…

2022-03-22 Thread GitBox
cambyzju opened a new pull request #8584: URL: https://github.com/apache/incubator-doris/pull/8584 … engine (#8217) Usage Example: 1. create table for test; `CREATE TABLE `array_test` ( `k1` tinyint(4) NOT NULL COMMENT "", `k2` smallint(6) NULL COMMENT "", `k3` AR

[incubator-doris] branch master updated (38ec3cb -> a498463)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 38ec3cb [feature-wip](array-type) Support ArrayLiteral in SQL. (#8089) (#8582) add a498463 [feat

[GitHub] [incubator-doris] morningman merged pull request #8584: [feature-wip](array-type)support select ARRAY data type on vectorized…

2022-03-22 Thread GitBox
morningman merged pull request #8584: URL: https://github.com/apache/incubator-doris/pull/8584 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] adonis0147 opened a new pull request #8585: [feature-wip][array-type] Array data can be loaded in stream load.

2022-03-22 Thread GitBox
adonis0147 opened a new pull request #8585: URL: https://github.com/apache/incubator-doris/pull/8585 # Proposed changes Issue Number: close #8367 ## Problem Summary: Please refer to #8367 . ## Checklist(Required) 1. Does it affect the original behavior: No

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8516: [feature-wip][UDF][DIP-1] support java UDF with fixed-length input and output

2022-03-22 Thread GitBox
github-actions[bot] commented on pull request #8516: URL: https://github.com/apache/incubator-doris/pull/8516#issuecomment-1074823549 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-doris] morningman commented on pull request #8585: [feature-wip][array-type] Array data can be loaded in stream load.

2022-03-22 Thread GitBox
morningman commented on pull request #8585: URL: https://github.com/apache/incubator-doris/pull/8585#issuecomment-1074823793 This PR is moved from array-type branch, which has been reviewed before. I will merge it now -- This is an automated message from the Apache Git Service. To respon

[GitHub] [incubator-doris] morningman merged pull request #8585: [feature-wip][array-type] Array data can be loaded in stream load.

2022-03-22 Thread GitBox
morningman merged pull request #8585: URL: https://github.com/apache/incubator-doris/pull/8585 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated: [feature-wip](array-type) Array data can be loaded in stream load. (#8368) (#8585)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new e44038c [feature-wip](array-type)

[GitHub] [incubator-doris] adonis0147 opened a new pull request #8586: [feature-wip][array-type] Support nested array insertion.

2022-03-22 Thread GitBox
adonis0147 opened a new pull request #8586: URL: https://github.com/apache/incubator-doris/pull/8586 # Proposed changes Issue Number: close #8304 . ## Problem Summary: Please refer to #8304 . ## Checklist(Required) 1. Does it affect the original behavior: N

[GitHub] [incubator-doris] morningman merged pull request #8586: [feature-wip][array-type] Support nested array insertion.

2022-03-22 Thread GitBox
morningman merged pull request #8586: URL: https://github.com/apache/incubator-doris/pull/8586 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated: [feature-wip](array-type) Support nested array insertion. (#8305) (#8586)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new b638c07 [feature-wip](array-type)

[GitHub] [incubator-doris] adonis0147 opened a new pull request #8587: [feature-wip][array-type] Fix compilation error.

2022-03-22 Thread GitBox
adonis0147 opened a new pull request #8587: URL: https://github.com/apache/incubator-doris/pull/8587 ## Problem Summary: Fix compilation error. ## Checklist(Required) 1. Does it affect the original behavior: No 2. Has unit tests been added: No Need 3. Has document

[incubator-doris] branch master updated (b638c07 -> a9f51b5)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from b638c07 [feature-wip](array-type) Support nested array insertion. (#8305) (#8586) add a9f51b5 [f

[GitHub] [incubator-doris] morningman merged pull request #8587: [feature-wip][array-type] Fix compilation error.

2022-03-22 Thread GitBox
morningman merged pull request #8587: URL: https://github.com/apache/incubator-doris/pull/8587 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] wangbo opened a new issue #8588: [Bug](vectorization) Float div wrong result

2022-03-22 Thread GitBox
wangbo opened a new issue #8588: URL: https://github.com/apache/incubator-doris/issues/8588 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version master

[GitHub] [incubator-doris] cambyzju opened a new pull request #8589: [feature-wip](array-type) Add array_contains and array_position functions

2022-03-22 Thread GitBox
cambyzju opened a new pull request #8589: URL: https://github.com/apache/incubator-doris/pull/8589 Add array_contans and array_position functions (#8401) array_contains function Usage example: 1. create table with ARRAY column, and insert some data: ``` > select * from array_

[GitHub] [incubator-doris] yinzhijian commented on pull request #8553: Dev.disk rebalance

2022-03-22 Thread GitBox
yinzhijian commented on pull request #8553: URL: https://github.com/apache/incubator-doris/pull/8553#issuecomment-1074830965 @caiconghui @yiguolei It does increase FE's responsibilities, but putting it in FE has its benefits: 1. It can control disk balance globally and avoid competin

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #8553: Dev.disk rebalance

2022-03-22 Thread GitBox
yangzhg commented on a change in pull request #8553: URL: https://github.com/apache/incubator-doris/pull/8553#discussion_r831849788 ## File path: fe/fe-core/src/main/java/org/apache/doris/clone/TabletScheduler.java ## @@ -1189,14 +1229,39 @@ private void selectTabletsForBalance

[GitHub] [incubator-doris] morningman merged pull request #8589: [feature-wip](array-type) Add array_contains and array_position functions

2022-03-22 Thread GitBox
morningman merged pull request #8589: URL: https://github.com/apache/incubator-doris/pull/8589 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated (a9f51b5 -> 71ce3c4)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from a9f51b5 [feature-wip](array-type) Fix compilation error. (#8422) (#8587) add 71ce3c4 [feature-wi

[GitHub] [incubator-doris] adonis0147 opened a new pull request #8590: [feature-wip](array-type) Support insertion for vectorized engine.

2022-03-22 Thread GitBox
adonis0147 opened a new pull request #8590: URL: https://github.com/apache/incubator-doris/pull/8590 # Proposed changes Issue Number: close #8493 . ## Problem Summary: Please refer to #8493 . ## Checklist(Required) 1. Does it affect the original behavior: N

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #8553: Dev.disk rebalance

2022-03-22 Thread GitBox
yangzhg commented on a change in pull request #8553: URL: https://github.com/apache/incubator-doris/pull/8553#discussion_r831856022 ## File path: fe/fe-core/src/main/java/org/apache/doris/clone/Rebalancer.java ## @@ -93,4 +101,20 @@ public Long getToDeleteReplicaId(TabletSchedC

[GitHub] [incubator-doris] caiconghui commented on pull request #8553: Dev.disk rebalance

2022-03-22 Thread GitBox
caiconghui commented on pull request #8553: URL: https://github.com/apache/incubator-doris/pull/8553#issuecomment-1074839234 > @caiconghui @yiguolei It does increase FE's responsibilities, but putting it in FE has its benefits: > > 1. It can control disk balance globally and avoid co

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #8553: Dev.disk rebalance

2022-03-22 Thread GitBox
yangzhg commented on a change in pull request #8553: URL: https://github.com/apache/incubator-doris/pull/8553#discussion_r831857583 ## File path: fe/fe-core/src/main/java/org/apache/doris/clone/BackendLoadStatistic.java ## @@ -315,6 +315,60 @@ public BalanceStatus isFit(long t

[incubator-doris] branch master updated (71ce3c4 -> 2580da4)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 71ce3c4 [feature-wip](array-type) Add codes and UT for array_contains and array_position functions (#8

[GitHub] [incubator-doris] morningman merged pull request #8590: [feature-wip](array-type) Support insertion for vectorized engine.

2022-03-22 Thread GitBox
morningman merged pull request #8590: URL: https://github.com/apache/incubator-doris/pull/8590 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] caiconghui edited a comment on pull request #8553: Dev.disk rebalance

2022-03-22 Thread GitBox
caiconghui edited a comment on pull request #8553: URL: https://github.com/apache/incubator-doris/pull/8553#issuecomment-1074839234 > @caiconghui @yiguolei It does increase FE's responsibilities, but putting it in FE has its benefits: > > 1. It can control disk balance globally and a

[GitHub] [incubator-doris] adonis0147 opened a new pull request #8591: [feature-wip](array-type) Fix compilation error.

2022-03-22 Thread GitBox
adonis0147 opened a new pull request #8591: URL: https://github.com/apache/incubator-doris/pull/8591 ## Problem Summary: Failed to run `run-be-ut.sh`, due to the commit #8476 . ## Checklist(Required) 1. Does it affect the original behavior: No 2. Has unit tests been a

[GitHub] [incubator-doris] feiver commented on issue #8563: OFFSET requires an ORDER BY clause:

2022-03-22 Thread GitBox
feiver commented on issue #8563: URL: https://github.com/apache/incubator-doris/issues/8563#issuecomment-1074840830 > 不排序那分页查询数据就不确定了,执行2次结果不一样 不是有默认排序么 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-doris] morningman merged pull request #8591: [feature-wip](array-type) Fix compilation error.

2022-03-22 Thread GitBox
morningman merged pull request #8591: URL: https://github.com/apache/incubator-doris/pull/8591 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated (2580da4 -> b522de8)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 2580da4 [feature-wip](array-type) Support insertion for vectorized engine. (#8494) (#8590) add b5

[GitHub] [incubator-doris] BiteTheDDDDt commented on pull request #8539: [Feature][Vectorized] Support explode json array func #8526

2022-03-22 Thread GitBox
BiteThet commented on pull request #8539: URL: https://github.com/apache/incubator-doris/pull/8539#issuecomment-1074843032 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8578: [fix](meta) Check_time return wrong value when exec show table status

2022-03-22 Thread GitBox
github-actions[bot] commented on pull request #8578: URL: https://github.com/apache/incubator-doris/pull/8578#issuecomment-1074846914 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-doris] yangzhg commented on pull request #8574: [refactor](schema_hash) remove schema_hash since every tablet id in be is unique

2022-03-22 Thread GitBox
yangzhg commented on pull request #8574: URL: https://github.com/apache/incubator-doris/pull/8574#issuecomment-1074857731 1. Does the command line of meta_tool also need to remove schema_hash? 2. Do all the http_action of be has schema_hash should remove schema_hash? If so, you should

[GitHub] [incubator-doris] cambyzju opened a new pull request #8594: [feature-wip](array-type) Fix conflict while merge array-type branch

2022-03-22 Thread GitBox
cambyzju opened a new pull request #8594: URL: https://github.com/apache/incubator-doris/pull/8594 # Proposed changes Fix conflict while merge array-type branch ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect t

[GitHub] [incubator-doris] yinzhijian commented on pull request #8553: Dev.disk rebalance

2022-03-22 Thread GitBox
yinzhijian commented on pull request #8553: URL: https://github.com/apache/incubator-doris/pull/8553#issuecomment-1074864940 > 1. Personally, I think that disk balancing does not affect the reliability of data like recover, so its priority is not high. If it is completed too quickly, i

[GitHub] [incubator-doris] yinzhijian edited a comment on pull request #8553: Dev.disk rebalance

2022-03-22 Thread GitBox
yinzhijian edited a comment on pull request #8553: URL: https://github.com/apache/incubator-doris/pull/8553#issuecomment-1074864940 > I personally think that the scalability of this implementation is not good, especially when there are a large number of machines. If there is data skew in t

[GitHub] [incubator-doris] yinzhijian edited a comment on pull request #8553: Dev.disk rebalance

2022-03-22 Thread GitBox
yinzhijian edited a comment on pull request #8553: URL: https://github.com/apache/incubator-doris/pull/8553#issuecomment-1074864940 > I personally think that the scalability of this implementation is not good, especially when there are a large number of machines. If there is data skew in t

[GitHub] [incubator-doris] morningman merged pull request #8594: [feature-wip](array-type) Fix conflict while merge array-type branch

2022-03-22 Thread GitBox
morningman merged pull request #8594: URL: https://github.com/apache/incubator-doris/pull/8594 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated (b522de8 -> 9f0b93e)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from b522de8 [feature-wip](array-type) Fix compilation error. (#8556) (#8591) add 9f0b93e [feature-wi

[GitHub] [incubator-doris] caiconghui commented on pull request #8574: [refactor](schema_hash) remove schema_hash since every tablet id in be is unique

2022-03-22 Thread GitBox
caiconghui commented on pull request #8574: URL: https://github.com/apache/incubator-doris/pull/8574#issuecomment-1074885172 > 1. Does the command line of meta_tool also need to remove schema_hash? > 2. Do all the http_action of be has schema_hash should remove schema_hash? If so, you s

[GitHub] [incubator-doris] morningman commented on pull request #8553: Dev.disk rebalance

2022-03-22 Thread GitBox
morningman commented on pull request #8553: URL: https://github.com/apache/incubator-doris/pull/8553#issuecomment-1074885308 > @caiconghui @yiguolei It does increase FE's responsibilities, but putting it in FE has its benefits: > > 1. It can control disk balance globally and avoid co

[GitHub] [incubator-doris] HappenLee opened a new issue #8595: [Bug] DCHECK failed in left semi/anti join with other join conjunct

2022-03-22 Thread GitBox
HappenLee opened a new issue #8595: URL: https://github.com/apache/incubator-doris/issues/8595 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version mast

[GitHub] [incubator-doris] HappenLee opened a new pull request #8596: [Bug][Vectorized] Fix bug of left semi/anti with other join conjunct

2022-03-22 Thread GitBox
HappenLee opened a new pull request #8596: URL: https://github.com/apache/incubator-doris/pull/8596 # Proposed changes Issue Number: close #8595 ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original beha

[GitHub] [incubator-doris] THELEMITED commented on issue #8588: [Bug](vectorization) Vectorization arithmetic inconsistent

2022-03-22 Thread GitBox
THELEMITED commented on issue #8588: URL: https://github.com/apache/incubator-doris/issues/8588#issuecomment-1074896374 c-hop -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [incubator-doris] cambyzju opened a new pull request #8597: [feature-wip](array-type)Add element_at and subscript functions

2022-03-22 Thread GitBox
cambyzju opened a new pull request #8597: URL: https://github.com/apache/incubator-doris/pull/8597 # Proposed changes Issue Number: close #7570 ## Problem Summary: Describe the overview of changes. 1. add function element_at; 2. support element_subscript([]) to get

[GitHub] [incubator-doris] cambyzju closed pull request #8475: [feature][array-type] support element_at and element_subscript([]) functions

2022-03-22 Thread GitBox
cambyzju closed pull request #8475: URL: https://github.com/apache/incubator-doris/pull/8475 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commi

[GitHub] [incubator-doris] xiepengcheng01 opened a new pull request #8599: replace rapidjson

2022-03-22 Thread GitBox
xiepengcheng01 opened a new pull request #8599: URL: https://github.com/apache/incubator-doris/pull/8599 # Proposed changes Issue Number: open #7551 ## Problem Summary: replace rapidjson with simdjson for handle simple json. ## Checklist(Required) 1. Does

[GitHub] [incubator-doris] yangzhg commented on pull request #8574: [refactor](schema_hash) remove schema_hash since every tablet id in be is unique

2022-03-22 Thread GitBox
yangzhg commented on pull request #8574: URL: https://github.com/apache/incubator-doris/pull/8574#issuecomment-1074933744 > > 1. Does the command line of meta_tool also need to remove schema_hash? > > 2. Do all the http_action of be has schema_hash should remove schema_hash? If so, you

[GitHub] [incubator-doris] 666chaoge666 opened a new issue #8600: [Bug] Broker Load 导入Hdfs 10亿量级数据失败

2022-03-22 Thread GitBox
666chaoge666 opened a new issue #8600: URL: https://github.com/apache/incubator-doris/issues/8600 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 当

[GitHub] [incubator-doris] dataalive commented on issue #8600: [Bug] Broker Load 导入Hdfs 10亿量级数据失败

2022-03-22 Thread GitBox
dataalive commented on issue #8600: URL: https://github.com/apache/incubator-doris/issues/8600#issuecomment-1074950171 pls show the table schema , and query sql without sensitive info. -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [incubator-doris] 666chaoge666 commented on issue #8600: [Bug] Broker Load 导入Hdfs 10亿量级数据失败

2022-03-22 Thread GitBox
666chaoge666 commented on issue #8600: URL: https://github.com/apache/incubator-doris/issues/8600#issuecomment-1074964690 > pls show the table schema , and query sql without sensitive info. 建表及load语句如下: CREATE TABLE t_user_dau_detail ( dt varchar(10) DEFAULT "", chann

[GitHub] [incubator-doris] junjie4585 commented on issue #8171: [Bug] binlog load 方式同步数据,报 errCode = 2, detailMessage = transaction not found异常

2022-03-22 Thread GitBox
junjie4585 commented on issue #8171: URL: https://github.com/apache/incubator-doris/issues/8171#issuecomment-1074982029 > 需要把源表的所有字段都列到后面,即使目标表中不需要的字段也要在列映射上指定。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #8599: replace rapidjson

2022-03-22 Thread GitBox
yangzhg commented on a change in pull request #8599: URL: https://github.com/apache/incubator-doris/pull/8599#discussion_r832017020 ## File path: be/CMakeLists.txt ## @@ -143,9 +143,6 @@ set_target_properties(gflags PROPERTIES IMPORTED_LOCATION ${THIRDPARTY_DIR}/lib/ add_libr

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #8599: replace rapidjson

2022-03-22 Thread GitBox
yangzhg commented on a change in pull request #8599: URL: https://github.com/apache/incubator-doris/pull/8599#discussion_r832020022 ## File path: be/src/exec/json_scanner.h ## @@ -147,14 +148,21 @@ class JsonReader { void _fill_slot(Tuple* tuple, SlotDescriptor* slot_desc,

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #8599: replace rapidjson

2022-03-22 Thread GitBox
yangzhg commented on a change in pull request #8599: URL: https://github.com/apache/incubator-doris/pull/8599#discussion_r832023482 ## File path: be/src/exec/json_scanner.cpp ## @@ -360,6 +365,79 @@ void JsonReader::_close() { _closed = true; } +Status JsonReader::_simd

[GitHub] [incubator-doris] 666chaoge666 closed issue #8600: [Bug] Broker Load 导入Hdfs 10亿量级数据失败

2022-03-22 Thread GitBox
666chaoge666 closed issue #8600: URL: https://github.com/apache/incubator-doris/issues/8600 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commit

[GitHub] [incubator-doris] 666chaoge666 removed a comment on issue #8600: [Bug] Broker Load 导入Hdfs 10亿量级数据失败

2022-03-22 Thread GitBox
666chaoge666 removed a comment on issue #8600: URL: https://github.com/apache/incubator-doris/issues/8600#issuecomment-1074964690 > pls show the table schema , and query sql without sensitive info. 建表及load语句如下: CREATE TABLE t_user_dau_detail ( dt varchar(10) DEFAULT "",

[GitHub] [incubator-doris] zbtzbtzbt commented on pull request #8555: (olap) (bugfix) fix hll-oom issue

2022-03-22 Thread GitBox
zbtzbtzbt commented on pull request #8555: URL: https://github.com/apache/incubator-doris/pull/8555#issuecomment-1075035432 ``` #elif __SSE2__ int loop = HLL_REGISTERS_COUNT / 16; // 16 = 128/8 uint8_t* dst = _registers.data; const uint8_t* src = other_reg

[GitHub] [incubator-doris] spaces-X commented on pull request #8234: [Feature] Support pre-aggregation for quantile type

2022-03-22 Thread GitBox
spaces-X commented on pull request #8234: URL: https://github.com/apache/incubator-doris/pull/8234#issuecomment-1075100669 @HappenLee @wangbo I've made the modifications as suggested by the reviewer. Please review it soon otherwise I need to keep resolving conflicts with master. --

[GitHub] [incubator-doris] morningman commented on pull request #8539: [Feature][Vectorized] Support explode json array func #8526

2022-03-22 Thread GitBox
morningman commented on pull request #8539: URL: https://github.com/apache/incubator-doris/pull/8539#issuecomment-1075111835 Hi @Lchangliang , please rebase to resolve the conflict -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8596: [Bug][Vectorized] Fix bug of left semi/anti with other join conjunct

2022-03-22 Thread GitBox
github-actions[bot] commented on pull request #8596: URL: https://github.com/apache/incubator-doris/pull/8596#issuecomment-1075111836 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-doris] whutpencil opened a new issue #8602: [Bug] Broker Load StringType cant set default_value

2022-03-22 Thread GitBox
whutpencil opened a new issue #8602: URL: https://github.com/apache/incubator-doris/issues/8602 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version mas

[GitHub] [incubator-doris] whutpencil opened a new pull request #8603: fix string default value bug

2022-03-22 Thread GitBox
whutpencil opened a new pull request #8603: URL: https://github.com/apache/incubator-doris/pull/8603 # Proposed changes Issue Number: close #8602 ## Problem Summary: Set the length of the string type field for analysis to the maximum allowed length ## Checklist(

[GitHub] [incubator-doris] caiconghui commented on pull request #8574: [refactor](schema_hash) remove schema_hash since every tablet id in be is unique

2022-03-22 Thread GitBox
caiconghui commented on pull request #8574: URL: https://github.com/apache/incubator-doris/pull/8574#issuecomment-1075185517 > > > 1. Does the command line of meta_tool also need to remove schema_hash? > > > 2. Do all the http_action of be has schema_hash should remove schema_hash? If s

[GitHub] [incubator-doris] chenlinzhong opened a new pull request #8604: [Feature] CSV import and export support header

2022-03-22 Thread GitBox
chenlinzhong opened a new pull request #8604: URL: https://github.com/apache/incubator-doris/pull/8604 # Proposed changes Issue Number: open #8487 ## Problem Summary: - Add two new types to stream load boker load: csv_with_names and csv_with_name_sand_types - Add two

[GitHub] [incubator-doris] xinyiZzz opened a new pull request #8605: [feature] (memory) Switch TLS mem tracker to separate more detailed memory usage

2022-03-22 Thread GitBox
xinyiZzz opened a new pull request #8605: URL: https://github.com/apache/incubator-doris/pull/8605 # Proposed changes Issue Number: close #7196 (step 3.1/3) ## Problem Summary: In pr #8476, all memory usage of a process is recorded in the process mem tracker, and all me

[GitHub] [incubator-doris] hf200012 opened a new pull request #8606: bug fix

2022-03-22 Thread GitBox
hf200012 opened a new pull request #8606: URL: https://github.com/apache/incubator-doris/pull/8606 bug fix # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the

[GitHub] [incubator-doris] morningman opened a new pull request #8607: [fix](load) fix another bug that BE may crash when calling `mark_as_failed`

2022-03-22 Thread GitBox
morningman opened a new pull request #8607: URL: https://github.com/apache/incubator-doris/pull/8607 # Proposed changes Issue Number: close #xxx ## Problem Summary: Same as #8501 ## Checklist(Required) 1. Does it affect the original behavior: (Yes/No/I Don

[GitHub] [incubator-doris] cambyzju commented on a change in pull request #8604: [Feature] CSV import and export support header

2022-03-22 Thread GitBox
cambyzju commented on a change in pull request #8604: URL: https://github.com/apache/incubator-doris/pull/8604#discussion_r832790258 ## File path: be/src/exec/broker_scanner.cpp ## @@ -103,6 +103,10 @@ Status BrokerScanner::get_next(Tuple* tuple, MemPool* tuple_pool, bool* eof

[GitHub] [incubator-doris] cambyzju commented on a change in pull request #8604: [Feature] CSV import and export support header

2022-03-22 Thread GitBox
cambyzju commented on a change in pull request #8604: URL: https://github.com/apache/incubator-doris/pull/8604#discussion_r832791535 ## File path: be/src/exec/broker_scanner.cpp ## @@ -161,6 +193,11 @@ Status BrokerScanner::open_file_reader() { if (start_offset != 0) {

[GitHub] [incubator-doris] morningman merged pull request #8516: [feature-wip][UDF][DIP-1] support java UDF with fixed-length input and output

2022-03-22 Thread GitBox
morningman merged pull request #8516: URL: https://github.com/apache/incubator-doris/pull/8516 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated (9f0b93e -> b89e4c7)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 9f0b93e [feature-wip](array-type) Fix conflict while merge array-type branch (#8594) add b89e4c7

[GitHub] [incubator-doris] morningman merged pull request #8577: [Bug] Fix error crc32 method to cal uint128 and int128

2022-03-22 Thread GitBox
morningman merged pull request #8577: URL: https://github.com/apache/incubator-doris/pull/8577 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] morningman closed issue #8576: [Bug] count distinct slower than origin

2022-03-22 Thread GitBox
morningman closed issue #8576: URL: https://github.com/apache/incubator-doris/issues/8576 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-

[incubator-doris] branch master updated (b89e4c7 -> 92feb9c)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from b89e4c7 [feature-wip](java-udf) support java UDF with fixed-length input and output (#8516) add 9

[incubator-doris] branch master updated: [fix] Fix Check_time return wrong value when exec show table status (#8578)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 72dfdb9 [fix] Fix Check_time retur

[GitHub] [incubator-doris] xiepengcheng01 commented on a change in pull request #8599: replace rapidjson

2022-03-22 Thread GitBox
xiepengcheng01 commented on a change in pull request #8599: URL: https://github.com/apache/incubator-doris/pull/8599#discussion_r832792273 ## File path: be/CMakeLists.txt ## @@ -143,9 +143,6 @@ set_target_properties(gflags PROPERTIES IMPORTED_LOCATION ${THIRDPARTY_DIR}/lib/ a

[GitHub] [incubator-doris] morningman merged pull request #8578: [fix](meta) Check_time return wrong value when exec show table status

2022-03-22 Thread GitBox
morningman merged pull request #8578: URL: https://github.com/apache/incubator-doris/pull/8578 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] morningman closed issue #8595: [Bug] DCHECK failed in left semi/anti join with other join conjunct

2022-03-22 Thread GitBox
morningman closed issue #8595: URL: https://github.com/apache/incubator-doris/issues/8595 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-

[GitHub] [incubator-doris] morningman merged pull request #8596: [Bug][Vectorized] Fix bug of left semi/anti with other join conjunct

2022-03-22 Thread GitBox
morningman merged pull request #8596: URL: https://github.com/apache/incubator-doris/pull/8596 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated: [fix][vectorized] Fix bug of left semi/anti with other join conjunct (#8596)

2022-03-22 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 36c85d2 [fix][vectorized] Fix bug

[GitHub] [incubator-doris] cambyzju commented on a change in pull request #8604: [Feature] CSV import and export support header

2022-03-22 Thread GitBox
cambyzju commented on a change in pull request #8604: URL: https://github.com/apache/incubator-doris/pull/8604#discussion_r832794668 ## File path: be/src/http/action/stream_load.cpp ## @@ -98,6 +98,40 @@ static TFileFormatType::type parse_format(const std::string& format_str,

[GitHub] [incubator-doris] cambyzju commented on a change in pull request #8604: [Feature] CSV import and export support header

2022-03-22 Thread GitBox
cambyzju commented on a change in pull request #8604: URL: https://github.com/apache/incubator-doris/pull/8604#discussion_r832794543 ## File path: be/src/http/action/stream_load.cpp ## @@ -98,6 +98,40 @@ static TFileFormatType::type parse_format(const std::string& format_str,

[GitHub] [incubator-doris] cambyzju commented on a change in pull request #8604: [Feature] CSV import and export support header

2022-03-22 Thread GitBox
cambyzju commented on a change in pull request #8604: URL: https://github.com/apache/incubator-doris/pull/8604#discussion_r832794873 ## File path: be/src/http/action/stream_load.cpp ## @@ -558,6 +606,8 @@ Status StreamLoadAction::_process_put(HttpRequest* http_req, StreamLoadC

[GitHub] [incubator-doris] morningman commented on pull request #8574: [refactor](schema_hash) remove schema_hash since every tablet id in be is unique

2022-03-22 Thread GitBox
morningman commented on pull request #8574: URL: https://github.com/apache/incubator-doris/pull/8574#issuecomment-1075856485 Schema hash is currently widely used in various modules of BE and is strongly related to the data itself. Strict review is required for schema hash modifications.

[GitHub] [incubator-doris] qidaye commented on issue #8220: [Bug] replace()无法替换首位字符,仅对首位以后的字符生效。

2022-03-22 Thread GitBox
qidaye commented on issue #8220: URL: https://github.com/apache/incubator-doris/issues/8220#issuecomment-1075858122 Thanks for your report @WhiskeyShang @dataalive . This bug has been fixed in [pr](https://github.com/apache/incubator-doris/pull/6605) -- This is an automated message

[GitHub] [incubator-doris] qidaye closed issue #8220: [Bug] replace()无法替换首位字符,仅对首位以后的字符生效。

2022-03-22 Thread GitBox
qidaye closed issue #8220: URL: https://github.com/apache/incubator-doris/issues/8220 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[GitHub] [incubator-doris] Lchangliang commented on pull request #8539: [Feature][Vectorized] Support explode json array func #8526

2022-03-22 Thread GitBox
Lchangliang commented on pull request #8539: URL: https://github.com/apache/incubator-doris/pull/8539#issuecomment-1075861986 > Hi @Lchangliang , please rebase to resolve the conflict I already rebase the code and check it. -- This is an automated message from the Apache Git Servic

  1   2   >