caiconghui commented on issue #8025: URL: https://github.com/apache/incubator-doris/issues/8025#issuecomment-1038876966
> > How to read and parse binlog > > There is a mature library called Debezium, which is used by Flink CDC. It can connect MySQL and convert binlog to defined record. I think we can add the dependency of Debezium to solve the problem. > > > Debezium > > > > > > > > How to read and parse binlog > > > > > > > > > There is a mature library called Debezium, which is used by Flink CDC. It can connect MySQL and convert binlog to defined record. I think we can add the dependency of Debezium to solve the problem. > > > > > > Based on past experience, you should run the binglog synchronization job on the be, and fe is only used to start the binlog synchronization job > > I came up this idea because the current Canal design is running synchronization job on FE, and send data to BE. Or do you know some cpp lib that similar with Debezium? no idea about cpp lib that parsing binlog. I think there are 3 solutions 1. continue to find cpp library to parse binlog 2. write code to parse binlog 3. parse binlog in broker so we can still use Debezium by pulling data from broker? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
