Re: Jobs running in flink are not viable in YARN resource manager WEB UI

2023-03-28 Thread Weihua Hu
I see. So the screenshots are using version 1.9.3. What does version 1.10.1 show? Best, Weihua On Wed, Mar 29, 2023 at 12:15 PM Kiran Kumar Kathe < kirankumarkathe...@gmail.com> wrote: > I am using yarn-cluster mode and command as ./flink run -m yarn-cluster > /home/kirankathe/s3checkup/origina

Re: Jobs running in flink are not viable in YARN resource manager WEB UI

2023-03-28 Thread Weihua Hu
Hi, > jobs are visible in YARN resource manager Web UI Which mode are you using to submit a job to YARN? Session mode or Perjob mode. IIUC, the YARN UI only shows Flink clusters, not jobs. Instead, the jobs will be shown in Flink ui. Best, Weihua On Tue, Mar 28, 2023 at 11:16 PM Martijn Visse

Re: Jobs running in flink are not viable in YARN resource manager WEB UI

2023-03-28 Thread Martijn Visser
Hi, I don't see anything in the 1.10 release notes [1] that would indicate that anything has changed between 1.9 and 1.10 that would indicate that something has changed on this topic. It should work. Best regards, Martijn [1] https://nightlies.apache.org/flink/flink-docs-release-1.10/release-no

Re: Jobs running in flink are not viable in YARN resource manager WEB UI

2023-03-28 Thread Kiran Kumar Kathe
Actually we are using 1.10.1 in YARN cluster in production , so to make changes in cluster it is bit complicated and it need to check all the jobs from first and need to test everything , so is there any chance of running the with the flink 1.10.1 by doing any configuration changes , that make j

Re: Jobs running in flink are not viable in YARN resource manager WEB UI

2023-03-28 Thread Martijn Visser
Hi, You can't mix and match different versions; they all need to be the same version. Flink 1.9.3 is no longer supported by the Flink community, I would recommend upgrading to a still supported version (which is currently Flink 1.16 and Flink 1.17) Best regards, Martijn On Tue, Mar 28, 2023 at

Jobs running in flink are not viable in YARN resource manager WEB UI

2023-03-28 Thread Kiran Kumar Kathe
When I submit jobs to flink using version 1.9.3 those jobs are visible in YARN resource manager Web UI , but when I use flink version 1.10.1 jobs running in flink are not visible in the Web UI , So in order to check where the issue is raising , I started replacing flink 1.10.1 folders with flink