RE: hdfs lease issues on flink retry

Hi David/Matthias, Just checking again on my previous question. From: Shah, Siddharth [Engineering] Sent: Thursday, September 23, 2021 9:46 AM To: 'David Morávek' ; Matthias Pohl Cc: Hailu, Andreas [Engineering] ; user@flink.apache.org; Erai, Rahul [Engineering] ; Chittaja

RE: hdfs lease issues on flink retry

, 2021 5:12 PM To: Shah, Siddharth [Engineering] Cc: Hailu, Andreas [Engineering] ; Matthias Pohl ; user@flink.apache.org Subject: Re: hdfs lease issues on flink retry Hi, AttemptId needs to be an integer (take a look at TaskAttemptID class for more details). As for your prior question, any random id

RE: hdfs lease issues on flink retry

org.apache.flink.runtime.taskmanager.Task.run(Task.java:530) at java.lang.Thread.run(Thread.java:745) Am I missing something here? Thanks, Siddharth From: Matthias Pohl Sent: Monday, September 20, 2021 4:54 AM To: Shah, Siddharth [Engineering] Cc: user@flink.apache.org; Hailu, Andreas

RE: hdfs lease issues on flink retry

d attempt__0123_r_0001_0 instead of attempt___r_0001_0. I have tested on a handful of our jobs and seems to be working fine. Just wanted to check any downside of this changes that I may not be aware of? Thanks, Siddharth From: Matthias Pohl Sent: Tuesday, September 07, 2021 5:06 AM T

RE: hdfs lease issues on flink retry

. From: Matthias Pohl Sent: Thursday, August 26, 2021 9:47 AM To: Shah, Siddharth [Engineering] Cc: user@flink.apache.org; Hailu, Andreas [Engineering] Subject: Re: hdfs lease issues on flink retry Hi Siddharth, thanks for reaching out to the community. This might be a bug. Could you share your

hdfs lease issues on flink retry

Hi Team, We are seeing transient failures in the jobs mostly requiring higher resources and using flink RestartStrategies [1]. Upon checking the yarn logs we hav