We haven't adapted Kettle yet, and the specific implementation of Kettle is to load data line by line by using insert. This is not an acceptable way for Doris. Doris needs to load data in batches.
It is recommended to use DataX doriswriter plug-in, or mysql odbc external table for mysql data synchronization or load. -- 此致！Best Regards 陈明雨 Mingyu Chen Email: morning...@163.com; morningman....@gmail.com At 2021-10-31 11:29:09, "Thomas Cai" <thomas...@126.com> wrote: >Dear All, > > >I tried to load data from MySQL to Doris by using Kettle tool and found there >was a limitation of 500 records. It means the job was successful if ETL >records were less than 500. And the job failed when the records were more >than 500, but the 500 records had still been loaded into Doris. > > >Does anyone meet the same situation by using Kettle before? Or there is any >Doris variance setting to fix the issue? Thanks. > > >Best Regards, >Thomas
