Re: Flink Job Deployment (Not enough resources)

2017-09-08 Thread Fabian Hueske
Hi Rinat, No, Flink does not have a switch to immediately cancel a job if it cannot allocate enough resources. Maybe YARN has a configuration parameter to define a timeout after which a job is canceled if no resource become available. 2017-09-04 13:29 GMT+02:00 Rinat : > Hi everyone, I’ve got th

Re: Flink Job Deployment

2017-09-08 Thread Fabian Hueske
Hi Rinat, no, this is unfortunately not possible. When a job is submitted, all required JARs are copied into an HDFS location that's job-specific. Best, Fabian 2017-09-04 13:11 GMT+02:00 Rinat : > Hi folks ! > I’ve got a question about running flink job on the top of YARN. > Is there any possib

Flink Job Deployment (Not enough resources)

2017-09-04 Thread Rinat
Hi everyone, I’ve got the following problem, when I’m trying to submit new job and if cluster has not enough resources, job submission fails with the following exception But in YARN job hangs and wait’s for requested resources. When resources become available, job successfully runs. What can I

Flink Job Deployment

2017-09-04 Thread Rinat
Hi folks ! I’ve got a question about running flink job on the top of YARN. Is there any possibility to store job sources in hdfs, for example /app/flink/job-name/ - /lib/*.jar - /etc/*.properties and specify directories, that should be added to the job classpath ? Thx.