Yizhou-Yang opened a new pull request, #8209:
URL: https://github.com/apache/inlong/pull/8209

   ### Prepare a Pull Request
   - Fixes #7900 
   
   ### Motivation
   See issue.
   
   ### Modifications
   Added PrimaryKeyPartitioner, and made modifications to support upsert-kafka
   
   
   ### Verifying this change
   1. execute the sql in the issue again
   2. create a kafka-mysql task to consume all the messages back to mysql
   
   the mysql table fluctuated from 1000-2000 rows, and in the end it reduced to 
0 rows, so I assume that the issue has been solved, since if it is still round 
robin, some update queries will be unordered, and it is unlikely that 3890 
remaining records can be reduced to 0. The format used is json, for 
canal-json/avro/csv, I only tested that the primaryKey partitition is in effect 
and there are no errors. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to