Re: Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

Thanks Chesnay. Will try and report back. On Fri, Jul 30, 2021, 10:19 Chesnay Schepler wrote: > Of course if is finding the file, you are actively pointing it towards it. > The BashJavaUtils are supposed to use the log4j configuration file *that > is bundled in the BashJavaUtils.jar, *which you

Re: Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

Of course if is finding the file, you are actively pointing it towards it. The BashJavaUtils are supposed to use the log4j configuration file /that is bundled in the BashJavaUtils.jar, /which you are now interfering with. That's also why it doesn't require all of lib/ to be on the classpath; th

Re: Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

It is finding the file though, the problem is that the lib/ might not be on the classpath when the file is being parsed, thus the YAML file is not recognized as being parsable. Is there a way to differ the inference from BashJavaUtils to the actual bootstrap of the app? or perhaps add the lib to t

Re: Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

That could be...could you try configuring "env.java.opts: -Dlog4j.configurationFile=..."? On 29/07/2021 15:18, Yuval Itzchakov wrote: Perhaps because I'm passing it as an argument to the job with -Dlog4j.configurationFile=... ? On Thu, Jul 29, 2021 at 3:27 PM Chesnay Schepler

Re: Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

Perhaps because I'm passing it as an argument to the job with -Dlog4j.configurationFile=... ? On Thu, Jul 29, 2021 at 3:27 PM Chesnay Schepler wrote: > Looking once more at the stacktrace this happens in the BashJavaUtils, > which only puts flink-dist and not the entire lib/ directory on the > c

Re: Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

Looking once more at the stacktrace this happens in the BashJavaUtils, which only puts flink-dist and not the entire lib/ directory on the classpath. What I don't understand is why it would pick up your log4j file. It should only use the file that is embedded within BashJavaUtils.jar. On 29/07

Re: Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

Hi Chesnay, So I looked into it, and jackson-databind is definitely in my UBER jar as a transitive dependency. Additionally, this uber JAR is added to the `lib/` directly for Flink before I start the job, yet it still fails. Are there any other paths I should explore? One thing to add is that I'm

Re: Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

Interesting, I don't have bind explicitly on the classpath, will give it a try. Although locally it is working properly. On Wed, Jul 7, 2021, 12:19 Chesnay Schepler wrote: > According to the log4j documentation you need both jackson-databind and > jackson-dataformat-yaml to be on the classpath.

Re: Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

According to the log4j documentation you need both jackson-databind and jackson-dataformat-yaml to be on the classpath. Did you make sure that that this is the case in 1.13.1? It could very well be that in 1.9 databind was on the classpath by chance. On 07/07/2021 10:22, Arvid Heise wrote: Hi

Re: Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

This seems to be a duplicate of an earlier thread. Please only respond there. On Mon, Jul 5, 2021 at 4:05 PM Yuval Itzchakov wrote: > Hi, > > I am attempting to upgrade Flink from 1.9 to 1.13.1 > I am using a YAML based log4j file. In 1.9, it worked perfectly fine by > adding the following depen

Re: Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

Hi Yuval, For some reason the YamlConfigurationFactory is not correctly loaded and the fallback XmlConfigurationFactory is used unsuccessfully. You could try to force DEBUG on that YamlConfigurationFactory and check for some output like "Missing dependencies for Yaml support, ConfigurationFactory

Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

Hi, I am attempting to upgrade Flink from 1.9 to 1.13.1 I am using a YAML based log4j file. In 1.9, it worked perfectly fine by adding the following dependency to the classpath (I deploy with an uber JAR): "com.fasterxml.jackson.dataformat" % "jackson-dataformat-yaml" % "2.12.3" However, with Fl

Flink 1.13 fails to load log4j2 yaml configuration file via jackson-dataformat-yaml

Hi, I am attempting to upgrade Flink from 1.9 to 1.13.1 I am using a YAML based log4j file. In 1.9, it worked perfectly fine by adding the following dependency to the classpath (I deploy with an uber JAR): "com.fasterxml.jackson.dataformat" % "jackson-dataformat-yaml" % "2.12.3" However