[
https://issues.apache.org/jira/browse/FLINK-29366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuan Kui updated FLINK-29366:
-----------------------------
Description:
Now we use a simple
implementation(org.apache.flink.configuration.GlobalConfiguration#loadYAMLResource)
to parse flink-conf.yaml, which can only parse simple key-value pairs.
Although there have been discussions on this issue
historically(see:[https://github.com/stratosphere/stratosphere/issues/113])
but I think that in the actual production environment, we often need to config
complex structure into flink-conf.yaml. At this time, the yaml libary is
required for parsing, so I suggest to use the yaml library to parse
flink-conf.yaml instead of our own implementation.
In fact, the flink-core module already has a dependency on flink-shaded-jackson
which could parse yaml format, we can use this jar without more dependencies.
was:
Now we use a simple
implementation(org.apache.flink.configuration.GlobalConfiguration#loadYAMLResource)
to parse flink-conf.yaml, which can only parse key-value pairs.
Although there have been discussions on this issue
historically(see:https://github.com/stratosphere/stratosphere/issues/113)
but I think that in the actual production environment, we often need to config
complex structure into flink-conf.yaml. At this time, the yaml libary is
required for parsing, so I suggest to use the yaml library to parse
flink-conf.yaml instead of our own implementation.
In fact, the flink-core module already has a dependency on flink-shaded-jackson
which could parse yaml format, we can use this jar without more dependencies.
> Use flink shaded jacson to parse flink-conf.yaml
> ------------------------------------------------
>
> Key: FLINK-29366
> URL: https://issues.apache.org/jira/browse/FLINK-29366
> Project: Flink
> Issue Type: Improvement
> Components: API / Core
> Affects Versions: 1.13.3
> Reporter: Yuan Kui
> Priority: Major
>
> Now we use a simple
> implementation(org.apache.flink.configuration.GlobalConfiguration#loadYAMLResource)
> to parse flink-conf.yaml, which can only parse simple key-value pairs.
> Although there have been discussions on this issue
> historically(see:[https://github.com/stratosphere/stratosphere/issues/113])
> but I think that in the actual production environment, we often need to
> config complex structure into flink-conf.yaml. At this time, the yaml libary
> is required for parsing, so I suggest to use the yaml library to parse
> flink-conf.yaml instead of our own implementation.
> In fact, the flink-core module already has a dependency on
> flink-shaded-jackson which could parse yaml format, we can use this jar
> without more dependencies.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
