[ https://issues.apache.org/jira/browse/FLINK-25262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17458120#comment-17458120 ]
Yuan Zhu commented on FLINK-25262: ---------------------------------- I think this was proposed before. > Support to send data to lookup table for KeyGroupStreamPartitioner way for > SQL > ------------------------------------------------------------------------------- > > Key: FLINK-25262 > URL: https://issues.apache.org/jira/browse/FLINK-25262 > Project: Flink > Issue Type: Improvement > Reporter: hehuiyuan > Priority: Minor > Attachments: image-2021-12-12-15-15-48-540.png, > image-2021-12-12-15-18-08-574.png > > > Send data to lookup table by hash , which can improve cache hit rate in > lookup table, futher improve processing performance and reduce the size of > cache. > > Shoulder we consider to introducing it? > > > !image-2021-12-12-15-18-08-574.png|width=419,height=193! > > I have a simple test. The parallelism is 10 and the kafka source has 100 > million records and the hbase lookuptable has 100 thousands records. It need > 100 minutes for forward and 5 minutes for hash. -- This message was sent by Atlassian Jira (v8.20.1#820001)