I missed the Reply All button in my previous message. Here's my previous email for the sake of transparency sent to the user ML once more:
Hi Oscar, sorry for the late reply. I didn't see that you posted the question at the beginning of the month already. I used jmap [1] in the past to get some statistics out and generate *.hprof files. I haven't looked into creating dump files as documented in [2]. env.java.opts.all will be passed to each java process that's triggered within Apache Flink. "dumponexit" (which is used in the documented code parameter list) suggests that the dump file would be created when the JVM process exits. Without any more detailed investigation on how the Java Flight Recorder works, I'd assume that a *.hprof file should be created when killing the JobManager/TaskManager process rather than cancelling an individual job. Cancelling the job should only trigger this file creation if you're using Flink in Application Mode because terminating the job would trigger the shutdown of the Flink cluster entirely in that case. Best, Matthias [1] https://docs.oracle.com/javase/8/docs/technotes/guides/troubleshoot/tooldescr014.html [2] https://nightlies.apache.org/flink/flink-docs-master/docs/ops/debugging/application_profiling/ On Thu, Nov 9, 2023 at 9:39 AM Oscar Perez via user <user@flink.apache.org> wrote: > hi [image: :wave:] I am trying to do profiling on one of our flink jobs > according to these docs: > https://nightlies.apache.org/flink/flink-docs-master/docs/ops/debugging/application_profiling/We > are using OpenJDK 8.0. I am adding this line to the flink properties file > in docker-compose: > > env.java.opts.all: "-XX:+UnlockCommercialFeatures > -XX:+UnlockDiagnosticVMOptions -XX:+FlightRecorder -XX:+DebugNonSafepoints > -XX:FlightRecorderOptions=defaultrecording=true,dumponexit=true,dumponexitpath=/tmp/dump.jfr" > > I would expect to see the dump.jfr file created once I cancel the job but > unfortunately I dont see anything created. How can I manage to get a valid > profile file? Thanks! > Regards, > Oscar >
