tianhui5 opened a new issue #8025: URL: https://github.com/apache/incubator-doris/issues/8025
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description The current binlog load architecture is like below, relying on Canal service. +---------------------------------------------+ | Mysql | +----------------------+----------------------+ | Binlog +----------------------v----------------------+ | Canal Server | +-------------------+-----^-------------------+ Get | | Ack +-------------------|-----|-------------------+ | FE | | | | +-----------------|-----|----------------+ | | | Sync Job | | | | | | +------------v-----+-----------+ | | | | | Canal Client | | | | | | +-----------------------+ | | | | | | | Receiver | | | | | | | +-----------------------+ | | | | | | +-----------------------+ | | | | | | | Consumer | | | | | | | +-----------------------+ | | | | | +------------------------------+ | | | +----+---------------+--------------+----+ | It ruins Doris' independency, user have to start a Canal service before use binlog load. It maybe not the best design, because it's hard to use, especially when there is no canal service in prod env. let alone the affect of avaibility and data consistency. ### Use case Load MySQL binlog to Doris. ### Related issues _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
