Re:Re: Re: Support for forced drop of user data

2020-11-22 Thread
Now, Doris support Drop partition, Drop Table, Drop database force operation, so if we doesn't want to recover metadata anymore, we can simple execute drop force operation. From Conghui Cai At 2020-11-23 10:05:46, "ling miao" wrote: >Or can we have a new command to clear metadata and data direct

New committer: Yingchun Lai

2021-06-23 Thread
The Podling Project Management Committee (PPMC) for Apache Doris has invited Yingchun Lai to become a committer and we are pleasedto announce that he has accepted. == Best Regards Conghui Cai Email : caicong...@apache.org

New committer: Zuo Wei

2021-06-30 Thread
The Podling Project Management Committee (PPMC) for Apache Dorishas invited Zuo Wei to become a committer and we are pleased to announce that he has accepted. == Best Regards Conghui Cai Email : caicong...@apache.org

Re:[Discuss] Preparation for release of Doris 0.15

2021-09-21 Thread
Hi,mingyu,here I have two PRs need to reviewd and then merged into Doris 0.15. 1. https://github.com/apache/incubator-doris/pull/6662 for little bug fix for load. 2. https://github.com/apache/incubator-doris/pull/6650 for meta unconsistent bug fix. At 2021-09-22 10:51:38, "陈明雨" wrote: >Hi All

Re:[VOTE] Release Apache Doris flink/spark connector 1.0.0

2022-01-05 Thread
+1 At 2022-01-05 15:52:44, "寒江雪" wrote: >Hi all, > >We are ready to deploy Doris connectors to Maven Central Repository, as the >version 1.0.0, and the next version will be 1.0.1 >This Release contains Spark connectors and Flink connectors for spark 2/3 >and flink 1.11/1.12/1.13 > >GitHub tags

Re:[Discuss & Vote] Create a new repo for Doris Flink/Spark Connector and Manager

2022-02-08 Thread
+1, That sounds more reasonable At 2022-02-09 14:54:26, "陈明雨" wrote: >Hi All: > > >Last month we try to release the doris flink/spakr connector 1.0.0[1]. But the >VOTE has been cancelled because: >1. This release was not voted on dev@doris >2. The object of this release is the flink/spark connec

Re:[VOTE] Release Flink Connectors v1.0.0 for Apache Doris(Incubating)

2022-02-14 Thread
+1 At 2022-02-14 17:03:28, "陈明雨" wrote: >Hi All, > > > > >This is a call for vote to release Flink Connectors v1.0.0 for Apache >Doris(Incubating). > > > > >There are 3 outputs for different Flink version: > > > > >- apache-doris-flink-connector-1.11.6-2.12-1.0.0-incubating > >-

Re:Re: Doris 限制并发查询量

2022-02-17 Thread
感谢田晖提出的这个feature,不过有两个点想提出来讨论下。首先qps是一个性能指标,在相当一部分场景下,qps高可能表示的是这个查询的延迟非常低,而不是可能达到集群瓶颈的标志,如我们的业务几百qps和几千qps也是有的,连接数也不高,主要都是低延迟查询。 另外是否可以考虑使用同是运行的sql在某个时刻不得超过多少比较好? 第二,我觉得限制的原则就是和C++类似,需要尽量做到零开销,即你不用的东西,你就不需要付出代价,我比较关注的是增加这个特性之后如果没使用的话,对我们原来的查询或元数据性能影响多大。

Re:回复: Re: Doris 限制并发查询量

2022-02-18 Thread
ubmission of SQL to the database, as far >as our internal scenarios are concerned, it may not be used in most >scenarios; >In short, system protection is a relatively comprehensive large-scale >system engineering, and qps is only one aspect. >What I agree with is that if you decide to

[Proposal] Support load data only with some tablets instead of all tablets in the partition to improve data loading stability

2022-02-21 Thread
Now,we want to improve the performance and stability of loading data,one way is only load some tablets in the partition instead of all tablets which may cause many little files and bring instability,and for stability I would gradually change it, the first step is to support tablet with version p

Re:Re: [Discuss][DSIP] Support load binlog from MySQL directly without relying other service

2022-03-29 Thread
I think one of the elegant implementations may be something like routine load 在 2022-03-30 10:47:39,"ling miao" 写道: >> Do you mean 'canal' component? >Yes. > >It sounds like you mean a new way about binlog load? >You can show the architecture diagram and general design on the wiki, so >that I can

Re:Re:Re: [Proposal] Support load data only with some tablets instead of all tablets in the partition to improve data loading stability

2022-03-29 Thread
ck >>granularity still table of tablet? >> >>Finally, I think this is a very valuable project for Doris Load,Can you >>provide a brief project plan? Including what are the parts of the whole, >>and what does each part do? This can help newcomers to quickly underst

Re:[VOTE] Graduate Apache Doris (Incubating) as a TLP

2022-04-06 Thread
+1, I am support for Graduating Apache Doris (Incubating) as a TLP At 2022-04-07 10:56:54, "陈明雨" wrote: >Hi all, > > > > >Apache Doris (Incubating) has been in development for over 3 years since it >entered the Apache incubator in September 2018. > >During our time in the Incubator, we have lear

[Discuss][Random Distribution Aggregate Table Query] Make consistent query result on Aggregate Keys table for both hash distribution and random distribution.

2022-06-26 Thread
Hi, all devs. Now Doris has supported random distribution for Duplicate Keys table and Aggregate Keys table without replace(replace_if_not_null) type column to solve data skew problem. But now, It brings some problem when we do some speical queris on aggregate table with random distribution.

Re:Re:[Discuss][DSIP] Support buffering data and automatically committing in Be to improve Doris real-time push ability

2022-06-29 Thread
Will there be too much performance drop if client insert records row by row? due to many rpcs? At 2022-06-29 21:31:02, "Mingyu Chen" wrote: >Hi Meiyi, >Thanks for you proposal. >And for "buffer the data in the server side(BE)", Doris already support the >"begin; insert; insert; insert; ...; co

Re:Re: How to insert hll_hash with flink?

2022-07-10 Thread
hi, song wang. now. flink-conncetor cannot do pre aggregation such as hll and bitmap outside doris. maybe you should enlarge the batch size and cocurrent num to achive your consume rate goal 100w/s 在 2022-07-11 12:43:04,"song wang" 写道: >Hi wudi, >Thank you for your reply, The introduction i

Re:Re: How to insert hll_hash with flink?

2022-07-11 Thread
it cannot be ok. because doris need data with hll type, now user cannot construct it outside doris At 2022-07-11 14:31:30, "song wang" wrote: >yes,I'm worried that writing Doris directly will increase the load of >Doris, so I want hll_hash(fieldName) outside doris by flink,can it work?

Re:Re: Re: How to insert hll_hash with flink?

2022-07-11 Thread
maybe, but now it is not in the roadmap of doris 在 2022-07-11 16:55:51,"song wang" 写道: >Will this data type be supported in the future? > > >蔡聪辉 于2022年7月11日周一 15:24写道: > >> it cannot be ok. because doris need data with hll type, >> now user cannot construct

Re:VOTE FOR DORIS 1.1.1-RC03 Release

2022-07-26 Thread
+1 (binding) [x] the download link is legitimate. [x] the checksum and PGP signature are legitimate. [x] the DISCLAIMER or DISCLAIMER-WIP is included. [x] the code matches the current release. [x] the LICENSE and NOTICE files are correct. [x] All files carry the necessary protocol description

Re:Vote for Apache Doris 1.1.5

2022-12-14 Thread
Here is my +1 At 2022-12-13 15:39:52, "GuoLei Yi" wrote: >Hi all, > >Please review and vote on Apache Doris 1.1.5 release. > >The release candidate has been tagged in GitHub as 1.1.5-rc02, available here: > >https://github.com/apache/doris/tree/1.1.5-rc02 > >This release is a bugfix release for 1

Re:Re: [Discussion] remove hadoop dpp code from Apache Doris

2023-01-16 Thread
+1 At 2023-01-17 10:31:27, "LinZhong,Chen" <490103...@qq.com.INVALID> wrote: >+1 > > > >---Original--- >From: "vin jake"Date: Mon, Jan 16, 2023 20:33 PM >To: "dev"Subject: Re: [Discussion] remove hadoop dpp code from Apache Doris > > >+1 >These code looks like don't need to maintain in new versio

Re: [Welcome] New Committers and PMC Members

2023-02-06 Thread
welcome! Replied Message | From | vin jake | | Date | 02/06/2023 21:44 | | To | dev@doris.apache.org | | Cc | | | Subject | Re: [Welcome] New Committers and PMC Members | Congratulations! On Mon, Feb 6, 2023 at 9:18 PM Gabriel Lee wrote: > Congrats! > > Best, > Gabriel > > On Mon, 6

Re:Re: [VOTE] Release Apache Doris 2.0.5

2024-02-25 Thread
Here is my vote + 1 (binding) At 2024-02-26 11:10:09, "GuoLei Yi" wrote: >Here is my(yiguolei) vote +1 (binding) > >Mingyu Chen 于2024年2月24日周六 23:59写道: >> >> Here is my(morningman) vote +1 (binding) >> >> >> >> >> I checked: >> >> >> >> >> [x] The download link is legal. >> >> [x] The PGP signatu