Re: [Proposal] Support Bucket Shuffle Join for Doris

2020-08-18 Thread Lee Happen
Hi Zhao Chun Let me explain the two questions you mentioned 1. Doris have data partition and data distribution meta, a certain bucket seq and partition can be located to a tablet. Each tablet may be distributed on different machines. if we both consider data partition and data distribution.

Re: [Proposal] Support Bucket Shuffle Join for Doris

2020-08-18 Thread Zhao Chun
Hi Happen Good proposal. If we want to carry out this work, we need to pay attention to several aspects. 1. The data partition and data distribution of Doris are two independent modules. If you want to transfer data according to the data distribution, the metadata information may be high, includ

[Proposal] Support Bucket Shuffle Join for Doris

2020-08-18 Thread Lee Happen
Motivation At present, Doris support 3 type join: shuffle join, broadcast join, colocate join. Except colocate join,another join will lead to a lot of network consumption. For example, there a SQL A join B, the cost of network. * broadcast join: if table A is divided into three parts,the n

Re:Re: [DISCUSS] Remove the DISCLAIMER-WIP

2020-08-18 Thread 陈明雨
Hi Willem: Thank you for you reply. Allow me to clarify the current situation of Doris. Please help us to confirm whether our understanding is correct. We rely on 3 third-party libraries. Their licenses are [1](GPL), [2](GPL), and [3](LGPL) respectively. We only link these third-party librarie

Re: [DISCUSS] Ready to release version 0.13.0

2020-08-18 Thread 张彬彬
Hi , I will add the source code of [Orthogonal Bitmap Udaf] in Version 0.13. The PR links is https://github.com/apache/incubator-doris/pull/4198 在 2020-08-19 11:08:44,"ling miao" 写道: >+ ZhangBinBin > >ling miao 于2020年8月19日周三 上午10:53写道: > >> Hi Lihaibo, >> >> I will add the sour

Re: [DISCUSS] Ready to release version 0.13.0

2020-08-18 Thread ling miao
+ ZhangBinBin ling miao 于2020年8月19日周三 上午10:53写道: > Hi Lihaibo, > > I will add the source code of [Query Cache] in Version 0.13. But I will > not emphasize this function in Release Nodes. > Because we haven't finished testing of this function. > > Ling Miao > > lihaibo 于2020年8月19日周三 上午10:48写道: >

Re: [DISCUSS] Ready to release version 0.13.0

2020-08-18 Thread ling miao
Hi Lihaibo, I will add the source code of [Query Cache] in Version 0.13. But I will not emphasize this function in Release Nodes. Because we haven't finished testing of this function. Ling Miao lihaibo 于2020年8月19日周三 上午10:48写道: > Please merge the feature: > > [Feature][Cache] Doris caches query

Re:[DISCUSS] Ready to release version 0.13.0

2020-08-18 Thread lihaibo
Please merge the feature: [Feature][Cache] Doris caches query results based on partition #2581 LiHaibo 2020-08-19 -- 网易VIP邮箱提醒:安全收发邮件,务必核实往来邮件地址、银行账号等机密信息,请通过电话或视频等多种方式确认信息真实性,提高警惕,请勿轻易透露个人重要信息。 Alert message of Netease Vipmail:Never provide your password, security questions, verification c

Re: [DISCUSS] Remove the DISCLAIMER-WIP

2020-08-18 Thread ling miao
Hi Willem, Does this mean that mysql driver cannot exist in our docker image or binary package? Ling Miao Willem Jiang 于2020年8月19日周三 上午8:09写道: > We need to check if the source kit has the third party dependency of > GPL and LGPL code. > We cannot ship the GPL and LGPL code with our source kit f

Re: 回复:[DISCUSS] Ready to release version 0.13.0

2020-08-18 Thread ling miao
Copy that. I will bring [Doris on ES] together in Version 0.13 Yunfeng Wu 于2020年8月18日周二 下午11:22写道: > Hi Ling Miao, > > >Add some `Doris On ES` stuff : > > > [Doris On ES][Feature] Support fetch `_id` field from ES.(#3900) > [Doris On ES][Feature] Support create table with wildcard or ali

Re: [DISCUSS] Remove the DISCLAIMER-WIP

2020-08-18 Thread Willem Jiang
We need to check if the source kit has the third party dependency of GPL and LGPL code. We cannot ship the GPL and LGPL code with our source kit for the License compliance requirement. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Mon, Aug 17, 2020 at 8:58 PM 陈明雨 wrote: > > Our previous

Re:Re: Re: [DISCUSS] Set SegmentV2 as the default format of Doris Storage

2020-08-18 Thread 陈明雨
Hi Yunfeng; Unfortunately, from the actual experience of online users, V2 has not been significantly improved, and even slightly decreased in some cases. I don’t know the reason. However, V2 is stronger than V1 in terms of code structure and function extension, so I think we should promote V2

Re:Re: Re:[Proposal] Support ODBC Scan Node for Doris

2020-08-18 Thread 陈明雨
Hi ZhaoChun, It is of course the best to let users upgrade without feeling. But the user must be aware of MysqlTable, because in the default compilation options, this function will be set to OFF. So users must be aware of this major version upgrade. We can consider providing some compiled odbc d

Re:回复:[DISCUSS] Ready to release version 0.13.0

2020-08-18 Thread Yunfeng Wu
Hi Ling Miao, Add some `Doris On ES` stuff : [Doris On ES][Feature] Support fetch `_id` field from ES.(#3900) [Doris On ES][Feature] Support create table with wildcard or aliase index. (#3968) [Doris On ES][Enhancement] Add docvalue limitation for doc_values scan and enable doc_val

Re: Re: [DISCUSS] Set SegmentV2 as the default format of Doris Storage

2020-08-18 Thread Zhao Chun
Hi, Yunfeng Yunfeng Wu 于2020年8月18日周二 下午8:11写道: > > > > Can we provide some performance performance comparision between v1 and v2. I was worried about the perfomance would slow down when do some string > field aggs opertion because of the `look up` of the `dict ordinary` > > Actually, in theor

Re:Re: [DISCUSS] Set SegmentV2 as the default format of Doris Storage

2020-08-18 Thread Yunfeng Wu
Can we provide some performance performance comparision between v1 and v2. I was worried about the perfomance would slow down when do some string field aggs opertion because of the `look up` of the `dict ordinary` -- -- 武云峰 email:wyfsky...@12

Re: 回复:[DISCUSS] Ready to release version 0.13.0

2020-08-18 Thread ling miao
OK, I will bring the [Doris on ES] together. Ling Miao Yunfeng Wu 于2020年8月18日周二 下午4:42写道: > > > > > > > Hi Ling Miao, > > >Add some `Doris On ES` stuff : > > > [Doris On ES][Feature] Support fetch `_id` field from ES.(#3900) > [Doris On ES][Feature] Support create table with wildcard or

Re: [DISCUSS] Set SegmentV2 as the default format of Doris Storage

2020-08-18 Thread Zhao Chun
+1 Thanks, Zhao Chun 41108453 <41108...@qq.com> 于2020年8月18日周二 下午12:24写道: > Yes, it should be like this, saving you having to configure each time > > > > > -- 原始邮件 -- > 发件人: > "dev" >

Re:回复:[DISCUSS] Ready to release version 0.13.0

2020-08-18 Thread Yunfeng Wu
Hi Ling Miao, Add some `Doris On ES` stuff : [Doris On ES][Feature] Support fetch `_id` field from ES.(#3900) [Doris On ES][Feature] Support create table with wildcard or aliase index. (#3968) [Doris On ES][Enhancement] Add docvalue limitation for doc_values scan and enable d

Re:Re: Re:[Proposal] Support ODBC Scan Node for Doris

2020-08-18 Thread Yunfeng Wu
Maybe we can provide `BreakingChanges` release notes to Doris. In every major Elasticserch version, it provide some `BreakingChanges` to notice the users. -- -- 武云峰 email:wyfsky...@126.com At 2020-08-18 14:03:21, "Zhao Chun" wrote: >Hi