[
https://issues.apache.org/jira/browse/FLINK-22678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuan Mei updated FLINK-22678:
-----------------------------
Description:
Per discussion on the mailing thread:
https://lists.apache.org/thread.html/ra178ce29088b1da362d98a5a6d8c7be48051caf1637ee24261738217%40%3Cdev.flink.apache.org%3E
We decide to make a refined version of loading ChangelogStateBackend:
- Define consistent override and combination policy (flag + state backend) in
different config levels
- Define explicitly the meaning of "enable flag" = true/false/unset
- Hide ChangelogStateBackend from users
Details described in
https://docs.google.com/document/d/13AaCf5fczYTDHZ4G1mgYL685FqbnoEhgo0cdwuJlZmw/edit?usp=sharing
was:
To enable/config Changelog Statebackend, we need to set
1. "state.backend.changelog.enabled" and
2. choose the state backend to be delegated
These two configs can be set in both Job level or cluster level; Job level
configs override Cluster level's.
If no state backend is set, a default one (Mem) is set.
There are two problems here:
=====
There are totally four combinations under this set up/overrides. The other
three work fine except
"state.backend.changelog.enabled" in Job level, but state backend is chosen in
cluster level.
The info of "state.backend.changelog.enabled" is lost.
> Hide ChangelogStateBackend From Users
> --------------------------------------
>
> Key: FLINK-22678
> URL: https://issues.apache.org/jira/browse/FLINK-22678
> Project: Flink
> Issue Type: Sub-task
> Reporter: Yuan Mei
> Priority: Major
>
> Per discussion on the mailing thread:
> https://lists.apache.org/thread.html/ra178ce29088b1da362d98a5a6d8c7be48051caf1637ee24261738217%40%3Cdev.flink.apache.org%3E
> We decide to make a refined version of loading ChangelogStateBackend:
> - Define consistent override and combination policy (flag + state backend)
> in different config levels
> - Define explicitly the meaning of "enable flag" = true/false/unset
> - Hide ChangelogStateBackend from users
> Details described in
> https://docs.google.com/document/d/13AaCf5fczYTDHZ4G1mgYL685FqbnoEhgo0cdwuJlZmw/edit?usp=sharing
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
