Re: Submitting a job in non-blocking mode using curl and the REST API

2021-01-05 Thread Chesnay Schepler
preciated - Original message - From: Chesnay Schepler To: Adam Roberts , user@flink.apache.org Cc: Subject: [EXTERNAL] Re: Submitting a job in non-blocking mode using curl and the REST API Date: Tue, Jan 5, 2021 4:07 PM All jobs going through the web-submissio

RE: Submitting a job in non-blocking mode using curl and the REST API

2021-01-05 Thread Adam Roberts
Thanks Chesnay for the prompt response - ah, so my cunning plan to use execution.attached=true doesn't sound so reasonable now then (I was going to look at providing that as a programArg next).   I did find, in https://ci.apache.org/projects/flink/flink-docs-release-1.11/release-notes/flink-1.11.ht

Re: Submitting a job in non-blocking mode using curl and the REST API

2021-01-05 Thread Chesnay Schepler
All jobs going through the web-submission are run in detached mode for technical reasons (blocking of threads, and information having to be transported back to the JobManager for things like collect()). You unfortunately cannot run non-detached/attached/blocking jobs via the web submission, wh

Submitting a job in non-blocking mode using curl and the REST API

2021-01-05 Thread Adam Roberts
Hey everyone, I've got an awesome looking Flink cluster set up with web.submit.enable=true, and plenty of bash for handling jar upload and then submission to a JobManager - all good so far.   Unfortunately, when I try to submit the classic WordCount example, I get a massive error with the jist of i