Re: YARN session application attempts

2016-04-19 Thread Till Rohrmann
Hi Stefano, Hadoop supports this feature since version 2.6.0. You can define a time interval for the maximum number of applications attempt. This means that you have to observe this number of application failures in a time interval before failing the application ultimately. Flink will activate thi

Re: YARN session application attempts

2016-04-12 Thread Stefano Baghino
Hi Ufuk, sorry for taking an awful lot of time to reply but I fell behind with the ML in the last couple of weeks due to lack of time. First of all, thanks for taking the time to help me. Yes, what I was saying was that apparently from the code (and effectively as we later found out after a couple

Re: YARN session application attempts

2016-04-02 Thread Ufuk Celebi
Hey Stefano, yarn.resourcemanager.am.max-attempts is a setting for your YARN cluster and cannot be influenced by Flink. Flink cannot set a higher number than this for yarn.application-attempts. The key that is set/overriden by Flink is probably only valid for the YARN session, but I'm not too fam

YARN session application attempts

2016-04-01 Thread Stefano Baghino
Hello everybody, I was asking myself: are there any best practices regarding how to set the `yarn.application-attempts` configuration key when running Flink on YARN as a long-running session? The configuration page on the docs states that 1 is the default and that it is recommended to leave it lik