>> It is recommended to use DataX doriswriter plug-in While I'm no longer involved in Kettle we have a number of bulk loaders in Apache Hop and would be happy to work with you in figuring out how to quickly load data into Doris.
Op di 2 nov. 2021 09:49 schreef 陈明雨 <morning...@163.com>: > We haven't adapted Kettle yet, and the specific implementation of Kettle > is to load data line by line by using insert. > This is not an acceptable way for Doris. Doris needs to load data in > batches. > > It is recommended to use DataX doriswriter plug-in, or mysql odbc external > table for mysql data synchronization or load. > > > > > -- > > 此致！Best Regards > 陈明雨 Mingyu Chen > > Email: > morning...@163.com; > morningman....@gmail.com > > > > > > At 2021-10-31 11:29:09, "Thomas Cai" <thomas...@126.com> wrote: > >Dear All, > > > > > >I tried to load data from MySQL to Doris by using Kettle tool and found > there was a limitation of 500 records. It means the job was successful if > ETL records were less than 500. And the job failed when the records were > more than 500, but the 500 records had still been loaded into Doris. > > > > > >Does anyone meet the same situation by using Kettle before? Or there is > any Doris variance setting to fix the issue? Thanks. > > > > > >Best Regards, > >Thomas >
