hailong wang created FLINK-15393:
------------------------------------
Summary: Change 'ReturnExpiredIfNotCleanedUp' to
'NeverReturnExpired' in JoinRecordStateViews#createTtlConfig
Key: FLINK-15393
URL: https://issues.apache.org/jira/browse/FLINK-15393
Project: Flink
Issue Type: Improvement
Components: Table SQL / Runtime
Affects Versions: 1.10.0
Reporter: hailong wang
Fix For: 1.11.0
In Blink planner, we use ttl state to clean expired data by rocksdb for regular
joins. The StateTtlConfig is:
{code:java}
StateTtlConfig
.newBuilder(Time.milliseconds(retentionTime))
.setUpdateType(StateTtlConfig.UpdateType.OnCreateAndWrite)
.setStateVisibility(StateTtlConfig.StateVisibility.ReturnExpiredIfNotCleanedUp)
.build();
{code}
I think we should use StateTtlConfig.StateVisibility.NeverReturnExpired to
prevent to join expired data.
BTW, Only regular joins use rocksdb filter to clean expired data, should we
change timer to rocksdb filter in other sql operator such as TemporalTableJoin?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
