Hi all, I've update the DISP: https://cwiki.apache.org/confluence/display/DORIS/DSIP-020%3A+Support+buffering+data+and+automatically+committing+for+stream+load Welcome to review and comment, thanks
Mingyu Chen <morning...@163.com> 于2022年6月30日周四 14:47写道： > Done: > https://cwiki.apache.org/confluence/display/DORIS/DSIP-020%3A+Support+buffering+data+and+automatically+committing+for+stream+load > > -- > > 此致！Best Regards > 陈明雨 Mingyu Chen > > Email: > morning...@apache.org > > > > > > 在 2022-06-30 11:31:15，"梅祎" <myime...@gmail.com> 写道： > >Hi all, thanks for your reply. Let me update details in DISP firstly. > >@Mingyu, my account is meiyi, thanks. > > > >王博 <wangbo13...@gmail.com> 于2022年6月30日周四 09:18写道： > > > >> Hi Meiyi, > >> Thanks for you proposal. > >> I would like to know why doris need this thing and what actually it is. > >> About what, it that you want to add something like kafka in Doris? > >> About why, can you explain more in what scenarios does the user need > this? > >> > >> 梅祎 <myime...@gmail.com> 于2022年6月29日周三 15:54写道： > >> > >> > Hi all, > >> > > >> > In current data import ways，users generally use StreamLoad to push > >> > real-time data to Doris, which need to buffer multiple records in the > >> > client side, and then send them to Doris together. It is pretty > complex > >> for > >> > users. > >> > > >> > We propose to buffer the data in the server side(BE) and commit > >> > automatically so that it is transparent to users and users can insert > >> > records row by row. > >> > > >> > I'll add detailed design later. > >> > > >> > >> > >> -- > >> 王博 Wang Bo > >> >
