Yizhou-Yang commented on code in PR #7924:
URL: https://github.com/apache/inlong/pull/7924#discussion_r1185687301


##########
inlong-sort/sort-connectors/kafka/src/main/java/org/apache/inlong/sort/kafka/partitioner/PrimaryKeyPartitioner.java:
##########


Review Comment:
   Hi!  RawdataHashPartitioner was based on canal/debezium data and are parsed 
using corresponding JsonDynamicFormat. In contrast, the PrimaryKeyPartitioner 
is used primarily in cases which does not have JsonDynamicFormat. If we use 
RawDataHashPartitioner, there will be Null Pointer Exceptions and it doesn't 
work.
   
   Another thing, design-wise, is that raw data is coming mostly from multiple 
sink scenerios, so instead of extending that partitioner, I want to make a 
seperate partitioner for single table, so that it might be more extendable and 
easier to maintain in the future.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@inlong.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to