Re: Change Akka Ask Timeout for Job Submission Only

2020-01-03 Thread Chesnay Schepler
There are 3 communication layers involved here: 1) client <=> server (REST API) This goes through REST and does not use timeouts AFAIK. We wait until a response comes or the connection terminates. 2) server (REST API) <=> processes (JM, Dispatcher) This goes through akka, with "web.timeout"

Re: Change Akka Ask Timeout for Job Submission Only

2019-12-19 Thread tison
Forward to user list. Best, tison. Abdul Qadeer 于2019年12月20日周五 下午12:57写道: > Around submission time, logs from jobmanager: > > {"timeMillis":1576764854245,"thread":"flink-akka.actor.default-dispatcher-1016","level":"INFO","loggerName":"org.apache.flink.runtime.dispatcher.StandaloneDispatcher","

Re: Change Akka Ask Timeout for Job Submission Only

2019-12-19 Thread tison
IIRC this issue is possibly caused by resource limited or some occasional reasons. Ever I heard that someone upgrade Java version and the issue vanished. For "akka.ask.timeout", it is used for all akka ask requests timeout. And I second Yang that the timeout is irrelevant with client-server connec

Re: Change Akka Ask Timeout for Job Submission Only

2019-12-19 Thread Yang Wang
It seems that not because the timeout of rest client. It is a server side akka timeout exception. Could you share the jobmanager logs? Best, Yang Abdul Qadeer 于2019年12月20日周五 上午10:59写道: > The relevant config here is "akka.ask.timeout". > > On Thu, Dec 19, 2019 at 6:51 PM tison wrote: > >> In pr

Re: Change Akka Ask Timeout for Job Submission Only

2019-12-19 Thread Abdul Qadeer
The relevant config here is "akka.ask.timeout". On Thu, Dec 19, 2019 at 6:51 PM tison wrote: > In previous version there is an "akka.client.timeout" option but it is > only used for timeout the future in client side so I don't think it change > akka scope timeout. > > Best, > tison. > > > Abdul

Re: Change Akka Ask Timeout for Job Submission Only

2019-12-19 Thread tison
In previous version there is an "akka.client.timeout" option but it is only used for timeout the future in client side so I don't think it change akka scope timeout. Best, tison. Abdul Qadeer 于2019年12月20日周五 上午10:44写道: > Hi! > > I am using Flink 1.8.3 and facing an issue where job submission th

Change Akka Ask Timeout for Job Submission Only

2019-12-19 Thread Abdul Qadeer
Hi! I am using Flink 1.8.3 and facing an issue where job submission through RestClusterClient times out on Akka (default value 10s). In previous Flink versions there was an option to set a different timeout value just for the submission client (ClusterClient config), but looks like it is not honor