Re: CVE-2021-44228 - Log4j2 vulnerability

Hi folks, When can we expect the release to be made available to the community? On Wed, Dec 22, 2021 at 3:07 PM David Morávek wrote: > Hi Debraj, > > we're currently not planning another emergency release as this CVE is not > as critical for Flink users as the previous one. However, this patch

Re: flink-table-api-scala-bridge missing source files

Hi Yuval, It seems that scala code is not included in `flink-table-api-scala-bridge_2.12-1.14.2-sources.jar` for now. You can find all the compiled code in the compiled jar (flink-table-api-scala-bridge_2.12-1.14.2.jar) for debugging. If we need to also include scala code in the sources.jar, we c

Re: Read parquet data from S3 with Flink 1.12

Hi Seth, Thank you for confirming the issue due to the transition in 1.14. For now, given my constraints, I will do a simple workaround and download the whole dataset with java aws library. For future reference though I would like to solve this I am actually still on 1.12 at the moment and had act

Re: How to handle java.lang.OutOfMemoryError: Metaspace

Hi John, Sounds to me you have a Flink standalone cluster deployed directly on physical hosts. If that is the case, use `t.m.flink.size` instead of `t.m.process.size`. The latter does not limit the overall memory consumption of the processes, and is only used for calculating how much non-JVM memor

Re: How to handle java.lang.OutOfMemoryError: Metaspace

Ok I tried taskmanager.memory.process.size: 7168m It's worst, the task manager can barely start before it throws java.lang.OutOfMemoryError: Metaspace I will try... taskmanager.memory.flink.size: 5120m taskmanager.memory.jvm-metaspace.size: 2048m On Sun, 26 Dec 2021 at 19:46, John Smith wrote:

How to handle java.lang.OutOfMemoryError: Metaspace

Hi running Flink 1.10 I have taskmanager.memory.flink.size: 6144m taskmanager.memory.jvm-metaspace.size: 1024m taskmanager.numberOfTaskSlots: 8 parallelism.default: 1 1- The host has a physical ram of 8GB. I'm better off just to configure "taskmanager.memory.process.size" as 7GB and let flink fi

Re: Avoiding Dynamic Classloading for User Code

Hey David, I placed the jar in flink folder but now I see some weird exceptions that weren't before: 1. In flink logs I see non stop Failed to access job archive location for path hdfs:/completed-jobs. java.io.FileNotFoundException: File hdfs:/completed-jobs does not exist. And after couple