Re: UI stability at high parallelism

2020-02-14 Thread Weihua Hu
These logs prove that it is indeed a timeout issue, In our scenario, it was due to the task deploy took a lot of time. You can check if the time from Task from SCHEDULED to DEPLOYING in the log is greater than 10s. This step are processed in mainThread and will block the processing of requests f

Re: UI stability at high parallelism

2020-02-14 Thread Richard Moorhead
2020-02-14 11:50:35,402 ERROR org.apache.flink.runtime.rest.handler.job.JobsOverviewHandler - Unhandled exception. akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/dispatcher#1293527273]] after [1 ms]. Message of type [org.apache.flink.runtime.rpc.messages.LocalFenced

Re: UI stability at high parallelism

2020-02-12 Thread HuWeihua
Hi, Richard This is most likely that the Rest Api has timed out, you can try to find some evidence in the jobmanager log. You can provide the full log to help us find the root cause. Best Weihua Hu > 2020年2月13日 09:40,Richard Moorhead 写道: > > When I submit a job to flink session with paralle

Re: UI stability at high parallelism

2020-02-12 Thread 张光辉
We also encountered a similar issue internally. cc +huweihua.ckl Richard Moorhead 于2020年2月13日周四 上午9:40写道: > When I submit a job to flink session with parallelism higher than 128, the > job is submitted and renders in the UI but when I view the job itself the > UI starts to rapidly emit errors in

UI stability at high parallelism

2020-02-12 Thread Richard Moorhead
When I submit a job to flink session with parallelism higher than 128, the job is submitted and renders in the UI but when I view the job itself the UI starts to rapidly emit errors in the upper right: Server Response: Unable to load requested file /bad-request. Is this a known issue? Is there a