Good to see that. But I can't see the image in your email. I created a DISP[1]. You can sign up the wiki and give me your account name, I can add permission to you. Then you can write your design in this DSIP.
And if it is acceptable, I suggest to create a new repo for this tool [1] https://cwiki.apache.org/confluence/display/DORIS/DSIP-036%3A+Doris+Kafka+Connector -- Best Regards Mingyu Chen Email: morning...@apache.org At 2024-03-01 15:18:14, "DongLiang Wu" <dongliang...@gmail.com> wrote: Hello everyone, I developed Doris-Kafka-Connector and hope to contribute to the Doris community. Doris-kafka-connector is a scalable and reliable data transfer tool that can accurately transfer data from kafka to doris. Currently doris-kafka-connector only supports data sink to doris, which has the following advantages: 1. Easy to expand. It can be deployed on a single machine or expanded to a distributed environment according to the amount of data in kafka. 2. Easy to use. The kafka framework natively supports connect, making deployment and use very simple. There are currently two deployment methods: Standalone mode: Standalone mode is the simplest mode, where a single process is responsible for executing all connectors and tasks. Distributed mode: Distributed mode provides scalability and automatic fault tolerance for Kafka Connect. 3. Supports multiple data formats. Currently, it has been tested to sink json, csv, and avro data formats into doris through Doris-kafka-connector. ------------------------------- Best Regards DongLiang Wu Email: dongliang...@gmail.com
