[ 
https://issues.apache.org/jira/browse/FLINK-17178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17085349#comment-17085349
 ] 

Benchao Li commented on FLINK-17178:
------------------------------------

[~jark] [~ykt836] we met this need in our company too. There is indeed a 
scenario that users don't care the lateness so much, periodically updating can 
satisfy them. And this has a limitation that the dimension table should be 
small enough such as 10k - 100k.

And users resolved this issue by themselves by implementing a UDF to do this.

>  Provide "ALL" cache strategy in LookupFunction
> -----------------------------------------------
>
>                 Key: FLINK-17178
>                 URL: https://issues.apache.org/jira/browse/FLINK-17178
>             Project: Flink
>          Issue Type: New Feature
>          Components: Connectors / Common
>            Reporter: Lijie Wang
>            Priority: Major
>
> We provide "ALL" cache strategy mentioned in FLINK-13252, motivation as 
> follow:
> Maintain the entire dimension table in memory to improve performance. There 
> is no IO overhead when we lookup the cached table. Reload dimension table 
> periodically for update, and we can reload asynchronously with little IO 
> delay.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to