回复： [Discuss][DSIP] Support load binlog from MySQL directly without relying other service

[晖]

Hi Yang,


I have not found any library we can use. Maybe it's a lot of work to put it on 
BE.


I think it's not necessary to put it in BE, Because we can distribute the sync 
job into 
other FE instead of Master, and user can use Flink Connector if there is still 
too much data. 




------------------ 原始邮件 ------------------
发件人:                                                                            
                                            "dev"                               
                                                     <xuyan...@baidu.com&gt;;
发送时间:&nbsp;2022年3月29日(星期二) 晚上8:38
收件人:&nbsp;"dev@doris.apache.org"<dev@doris.apache.org&gt;;

主题:&nbsp;Re: [Discuss][DSIP] Support load binlog from MySQL directly without 
relying other service



Hi hui, 
Thanks for the pr.
Is there any way to integrate the binlog aquire and parse function into Be, 
instead of Fe?

在 2022/3/29 下午8:13，“ling miao”<lingm...@apache.org&gt; 写入:

&nbsp;&nbsp;&nbsp; Hi hui,

&nbsp;&nbsp;&nbsp; I want to know what is the reason for canceling the cancel 
component? Is
&nbsp;&nbsp;&nbsp; there any problem in use? What are the benefits ?

&nbsp;&nbsp;&nbsp; Parsing binlog is not actually the function of Doris itself. 
Or is it
&nbsp;&nbsp;&nbsp; better to appear as a connector? For example, like Flink 
connector.

&nbsp;&nbsp;&nbsp; Ling Miao

&nbsp;&nbsp;&nbsp; 陈明雨 <morning...@163.com&gt; 于2022年3月29日周二 19:46写道：

&nbsp;&nbsp;&nbsp; &gt; Hi Hui,
&nbsp;&nbsp;&nbsp; &gt; Thanks for it. Could you register a cwiki acount and 
tell me your account
&nbsp;&nbsp;&nbsp; &gt; id? So that I can create DSIP and grant write priv for 
you.
&nbsp;&nbsp;&nbsp; &gt; https://cwiki.apache.org/confluence/signup.action
&nbsp;&nbsp;&nbsp; &gt;
&nbsp;&nbsp;&nbsp; &gt;
&nbsp;&nbsp;&nbsp; &gt;
&nbsp;&nbsp;&nbsp; &gt;
&nbsp;&nbsp;&nbsp; &gt; --
&nbsp;&nbsp;&nbsp; &gt;
&nbsp;&nbsp;&nbsp; &gt; 此致！Best Regards
&nbsp;&nbsp;&nbsp; &gt; 陈明雨 Mingyu Chen
&nbsp;&nbsp;&nbsp; &gt;
&nbsp;&nbsp;&nbsp; &gt; Email:
&nbsp;&nbsp;&nbsp; &gt; chenmin...@apache.org
&nbsp;&nbsp;&nbsp; &gt;
&nbsp;&nbsp;&nbsp; &gt;
&nbsp;&nbsp;&nbsp; &gt;
&nbsp;&nbsp;&nbsp; &gt;
&nbsp;&nbsp;&nbsp; &gt;
&nbsp;&nbsp;&nbsp; &gt; At 2022-03-29 18:17:02, "晖" 
<827677...@qq.com.INVALID&gt; wrote:
&nbsp;&nbsp;&nbsp; &gt; &gt;As issue #8025(
&nbsp;&nbsp;&nbsp; &gt; 
https://github.com/apache/incubator-doris/issues/8025)&amp;nbsp;mentioned,
&nbsp;&nbsp;&nbsp; &gt; the current binlog load is relying on Canal service. We 
can integrate the
&nbsp;&nbsp;&nbsp; &gt; binlog aquire and parse function into Doris, so that 
user can be more
&nbsp;&nbsp;&nbsp; &gt; convinience to use it.Please determine the final DSIP 
number for it.
&nbsp;&nbsp;&nbsp; &gt;


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For additional commands, e-mail: dev-h...@doris.apache.org