Re:Re: [Discuss][DSIP] Support buffering data and automatically committing in Be to improve Doris real-time push ability

Done: https://cwiki.apache.org/confluence/display/DORIS/DSIP-020%3A+Support+buffering+data+and+automatically+committing+for+stream+load -- 此致！Best Regards 陈明雨 Mingyu Chen Email: morning...@apache.org 在 2022-06-30 11:31:15，"梅祎" 写道： >Hi all, thanks for your reply. Let me update details in D

Re: [Discuss][DSIP] Support buffering data and automatically committing in Be to improve Doris real-time push ability

Hi all, thanks for your reply. Let me update details in DISP firstly. @Mingyu, my account is meiyi, thanks. 王博 于2022年6月30日周四 09:18写道： > Hi Meiyi, > Thanks for you proposal. > I would like to know why doris need this thing and what actually it is. > About what, it that you want to add something l

Re: [Discuss][DSIP] Support buffering data and automatically committing in Be to improve Doris real-time push ability

Hi Meiyi, Thanks for you proposal. I would like to know why doris need this thing and what actually it is. About what, it that you want to add something like kafka in Doris? About why, can you explain more in what scenarios does the user need this? 梅祎 于2022年6月29日周三 15:54写道： > Hi all, > > In curr

Re:Re:[Discuss][DSIP] Support buffering data and automatically committing in Be to improve Doris real-time push ability

Will there be too much performance drop if client insert records row by row？ due to many rpcs？ At 2022-06-29 21:31:02, "Mingyu Chen" wrote: >Hi Meiyi, >Thanks for you proposal. >And for "buffer the data in the server side(BE)", Doris already support the >"begin; insert; insert; insert; ...; co

Re:[Discuss][DSIP] Support buffering data and automatically committing in Be to improve Doris real-time push ability

Hi Meiyi, Thanks for you proposal. And for "buffer the data in the server side(BE)", Doris already support the "begin; insert; insert; insert; ...; commit" method, which is also a kind of "buffer data in server side" feature for "insert into values" operations. Maybe you can explain more about

Re:Re:Re:Re:Re: [Discuss] Prepare to release 1.1

There is a bug that may cause query stuck, which has been fix in master branch[1]. So I cherry-pick part of it to dev-1.0.1 branch[2] and make a new tag 1.1.0-rc02[3] [1] https://github.com/apache/doris/pull/10214 [2] https://github.com/apache/doris/commit/589b44eddf6eafcd55057468de828b2c222ce

Re: Re: [Discuss][DSIP] Support Merge-On-Write implementation for UNIQUE KEY data model

Updated the scheduling https://cwiki.apache.org/confluence/display/DORIS/DSIP-018%3A+Support+Merge-On-Write+implementation+for+UNIQUE+KEY+data+model Best Chen Zhang 在 2022年6月27日 +0800 11:59，Chen Zhang ，写道： > Hi Devs, I've update the DISP last weekend, if you are interest on this > feature, welcom

?????? ????streamload??????????????abort reason: coordinate BE is down

??BEload??BE?? --  -- ??: "dev"

Re: 通过streamload导入数据报异常abort reason: coordinate BE is down

应该是你的be挂了 show backends 看看 james <23461...@qq.com.invalid>于2022年6月29日 周三15:44写道： > 您好！ > > >      系统的部署情况说明：一台FE，3台BE 部署在一个局域网内。 > > >      在通过streamload导入大量数据时候，报上面的错误！ > 请问一般在什么情况下可能出现这样的问题，有什么解决方案没。 > BE 的 日志内容如下： > > > W0625 21:11:04.788328 19871 stream_load_executor.cpp:281] commit > trans

Spark????Doris 1.0???????????????? Unrecognized field "keysType"

??       ??doris 1.0    1??FE,3??BE.       sparkdoris org.apache.doris.spark.exception.DorisException: Doris FE's response cannot map to schema. res: {"keysType":"DUP_KEYS","properties":[{"name":"id","aggregation_type":"","comment":" id","typ

[Discuss][DSIP] Support buffering data and automatically committing in Be to improve Doris real-time push ability

Hi all, In current data import ways，users generally use StreamLoad to push real-time data to Doris, which need to buffer multiple records in the client side, and then send them to Doris together. It is pretty complex for users. We propose to buffer the data in the server side(BE) and commit autom

????streamload??????????????abort reason: coordinate BE is down

??      FE??3??BE      ??streamload ?? BE ?? ?? W0625 21:11:04.788328 19871 stream_load_executor.cpp:281] commit transaction failed, errms

Re:Re:Re:Re: [Discuss] Prepare to release 1.1

The first release candidate tag is: https://github.com/apache/doris/tree/1.1.0-rc01 -- 此致！Best Regards 陈明雨 Mingyu Chen Email: morning...@apache.org 在 2022-06-29 15:05:44，"Mingyu Chen" 写道： >Hi all, >The outer join bug has been fixed in dev-1.0.1. >And also fix some other bugs. > > >This

Re:Re:Re: [Discuss] Prepare to release 1.1

Hi all, The outer join bug has been fixed in dev-1.0.1. And also fix some other bugs. This thread is closed and I will start vote for the v1.1 release. -- 此致！Best Regards 陈明雨 Mingyu Chen Email: morning...@apache.org 在 2022-06-27 09:52:53，"陈明雨" 写道： >Hi all, >The dev-1.0.1 is now closed.