[GitHub] [incubator-doris] wuyunfeng opened a new pull request #5006: [Doris][Doris On ES] support prefix @ symbol for column name

2020-12-01 Thread GitBox
wuyunfeng opened a new pull request #5006: URL: https://github.com/apache/incubator-doris/pull/5006 ## Proposed changes Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature req

[GitHub] [incubator-doris] wuyunfeng opened a new issue #5005: [Doris][Doris On ES] [Proposal] Support `@` leading column name

2020-12-01 Thread GitBox
wuyunfeng opened a new issue #5005: URL: https://github.com/apache/incubator-doris/issues/5005 **Is your feature request related to a problem? Please describe.** 1. Elasticsearch users maybe use `Logstash` transform and transmit data to ES, the `Logstash` would add `@` leading field

[GitHub] [incubator-doris] morningman opened a new pull request #5004: [Function] Let "str_to_date" return correct type

2020-12-01 Thread GitBox
morningman opened a new pull request #5004: URL: https://github.com/apache/incubator-doris/pull/5004 ## Proposed changes The return type of str_to_date depends on whether the time part is included in the format. If included, it is DATETIME, otherwise it is DATE. If the format p

[GitHub] [incubator-doris] wangbo opened a new pull request #5003: (#5002) ConcurrentModificationException when finish transaction

2020-12-01 Thread GitBox
wangbo opened a new pull request #5003: URL: https://github.com/apache/incubator-doris/pull/5003 ## Proposed changes ## Types of changes - [x] Bugfix (non-breaking change which fixes an issue) ## Checklist _Put an `x` in the boxes that apply. You can a

[GitHub] [incubator-doris] wangbo opened a new issue #5002: [BUG]ConcurrentModificationException when finish transaction

2020-12-01 Thread GitBox
wangbo opened a new issue #5002: URL: https://github.com/apache/incubator-doris/issues/5002 **Describe the bug** ``` 2020-12-01 21:53:59,216 WARN 37 [PublishVersionDaemon.publishVersion():210] finish ts 1046352935 failed java.util.ConcurrentModificationException: null a

[GitHub] [incubator-doris] acelyc111 opened a new issue #5001: [Bug] Current access _tablets_under_clone/restore should also sharding

2020-12-01 Thread GitBox
acelyc111 opened a new issue #5001: URL: https://github.com/apache/incubator-doris/issues/5001 **Describe the bug** I found a coredump backtrace looks like: ``` Program terminated with signal 11, Segmentation fault. #0 _M_lower_bound (this=, __k=, __y=0x1abc07c80, __x=0x20) at

[GitHub] [incubator-doris] acelyc111 opened a new pull request #5000: [Bug] Fix concurrent access of _tablets_under_clone in TabletManager

2020-12-01 Thread GitBox
acelyc111 opened a new pull request #5000: URL: https://github.com/apache/incubator-doris/pull/5000 ## Proposed changes '_tablets_under_clone' in TabletManager is not sharded but the lock used to prevent concurrent access is sharded, so when shards size is not 1, it will cau

[GitHub] [incubator-doris] HappenLee opened a new pull request #4999: [Performance Optimization] Remove push down conjuncts in olap scan node

2020-12-01 Thread GitBox
HappenLee opened a new pull request #4999: URL: https://github.com/apache/incubator-doris/pull/4999 ## Proposed changes Push conjunct to Storage Engine as more as possible olap scan node do not need filter data use push down conjuncts again. fix #4986 ## Types of

[incubator-doris] branch master updated: [Doris On ES][Bug-fix] fix boolean predicate pushdown manner (#4990)

2020-12-01 Thread wyf
This is an automated email from the ASF dual-hosted git repository. wyf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new af06adb [Doris On ES][Bug-fix] fix boolea

[GitHub] [incubator-doris] wuyunfeng closed issue #4989: [Doris On ES][Bug] Doris On Es Boolean Field Push Down error

2020-12-01 Thread GitBox
wuyunfeng closed issue #4989: URL: https://github.com/apache/incubator-doris/issues/4989 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [incubator-doris] wuyunfeng merged pull request #4990: [Doris On ES][Bug-fix] fix boolean predicate pushdown manner

2020-12-01 Thread GitBox
wuyunfeng merged pull request #4990: URL: https://github.com/apache/incubator-doris/pull/4990 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-doris] weizuo93 opened a new pull request #4998: [Optimize] Take 'deleted rows' into consideration when selecting a tablet for compaction task

2020-12-01 Thread GitBox
weizuo93 opened a new pull request #4998: URL: https://github.com/apache/incubator-doris/pull/4998 ## Proposed changes The rows deleted by `delete operation` will not be deleted from the disk untill base compaction for the relevant tablet is performed. The data deleted logically not

[GitHub] [incubator-doris] weizuo93 opened a new issue #4997: [Proposal] Take 'deleted rows' into consideration when selecting a tablet for compaction task

2020-12-01 Thread GitBox
weizuo93 opened a new issue #4997: URL: https://github.com/apache/incubator-doris/issues/4997 The rows deleted by `delete operation` will not be deleted from the disk untill base compaction for the relevant tablet is performed. The data deleted logically not only occupies disk space, but a

[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #4994: [Docs]adding mannully modify partitions instructions to dynamic partition feature

2020-12-01 Thread GitBox
EmmyMiao87 commented on a change in pull request #4994: URL: https://github.com/apache/incubator-doris/pull/4994#discussion_r533385137 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -321,3 +321,11 @@ mysql> SHOW DYNAMIC PARTITION TABLES; HTTP 协议:

[GitHub] [incubator-doris] acelyc111 opened a new issue #4996: [Bug] Should not assume the tablet is newer by it's load time when BE start

2020-12-01 Thread GitBox
acelyc111 opened a new issue #4996: URL: https://github.com/apache/incubator-doris/issues/4996 **Describe the bug** I found a coredump, back trace look like: ``` Program terminated with signal 6, Aborted. #0 0x7fca7abcb1d7 in raise () from /lib64/libc.so.6 Missing separat

[GitHub] [incubator-doris] xinghuayu007 commented on issue #4995: [Proposal] Separate Page Cache by page type

2020-12-01 Thread GitBox
xinghuayu007 commented on issue #4995: URL: https://github.com/apache/incubator-doris/issues/4995#issuecomment-736425626 it looks wonderful! This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #4990: [Doris On ES][Bug-fix] fix boolean predicate pushdown manner

2020-12-01 Thread GitBox
wuyunfeng commented on a change in pull request #4990: URL: https://github.com/apache/incubator-doris/pull/4990#discussion_r533312497 ## File path: be/src/exec/es/es_query_builder.cpp ## @@ -50,19 +50,39 @@ void ESQueryBuilder::to_json(rapidjson::Document* document, rapidjson:

[GitHub] [incubator-doris] Skysheepwang opened a new issue #4995: [Proposal] Separate Page Cache by page type

2020-12-01 Thread GitBox
Skysheepwang opened a new issue #4995: URL: https://github.com/apache/incubator-doris/issues/4995 Currently, all types of pages (including DATA_PAGE, INDEX_PAGE, DICT_PAGE, SHORT_KEY_PAGE) in segment_v2 are cached by StoragePageCache in one single memory space. In many query situations, we

[GitHub] [incubator-doris] qidaye opened a new pull request #4994: [Docs]adding mannully modify partitions instructions to dynamic partition feature

2020-12-01 Thread GitBox
qidaye opened a new pull request #4994: URL: https://github.com/apache/incubator-doris/pull/4994 ## Proposed changes There is no clear instruction to mannully modify partitions, when dynamic partition feature is enabled. The user will be informed only after trying to modify th

[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #4993: [Bug] fix finished load jobs cost too much heap

2020-12-01 Thread GitBox
EmmyMiao87 commented on a change in pull request #4993: URL: https://github.com/apache/incubator-doris/pull/4993#discussion_r533159363 ## File path: fe/fe-core/src/test/java/org/apache/doris/load/loadv2/LoadJobTest.java ## @@ -19,6 +19,7 @@ package org.apache.doris.load.loadv

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #4990: [Doris On ES][Bug-fix] fix boolean predicate pushdown manner

2020-12-01 Thread GitBox
chaoyli commented on a change in pull request #4990: URL: https://github.com/apache/incubator-doris/pull/4990#discussion_r533153262 ## File path: be/src/exec/es/es_query_builder.cpp ## @@ -50,19 +50,39 @@ void ESQueryBuilder::to_json(rapidjson::Document* document, rapidjson::V

[GitHub] [incubator-doris] morningman commented on a change in pull request #4991: [Enhance] Add "statistics" meta table and fix some mysql compatibility problem

2020-12-01 Thread GitBox
morningman commented on a change in pull request #4991: URL: https://github.com/apache/incubator-doris/pull/4991#discussion_r533142814 ## File path: fe/fe-core/src/main/java/org/apache/doris/catalog/PrimitiveType.java ## @@ -710,7 +718,8 @@ public MysqlColType toMysqlType() {

[GitHub] [incubator-doris] qidaye opened a new pull request #4993: [Bug] fix finished load jobs cost too much heap

2020-12-01 Thread GitBox
qidaye opened a new pull request #4993: URL: https://github.com/apache/incubator-doris/pull/4993 ## Proposed changes when load job finished, there is no need to hold the tasks which are the biggest memory consumers. fix bug [https://github.com/apache/incubator-doris/issues/4992

[GitHub] [incubator-doris] qidaye opened a new issue #4992: [bug] finished load jobs cost too much heap memory

2020-12-01 Thread GitBox
qidaye opened a new issue #4992: URL: https://github.com/apache/incubator-doris/issues/4992 **Describe the bug** Current, labels of finished or cancelled load jobs will be removed after *label_keep_max_second*, default 3 days. All load jobs' info is kept in memory before being remov