Re: rpc invocation exceeds the maximum akka framesize

2021-09-28 Thread Roman Khachatryan
Hi, There could be many reasons for exceeding akka framesize, for example 1. "inlined" state that is stored in checkpoint .metadata file (rather than "data" files - see [1]) 2. broadcast state as you mentioned (though only the metadata is sent unless the data fits the above limits) 3. too many sta

Re: rpc invocation exceeds the maximum akka framesize

2021-09-28 Thread Deshpande, Omkar
Is the akka framesize a function of broadcast size? From: Deshpande, Omkar Sent: Monday, September 27, 2021 6:31 PM To: user@flink.apache.org Cc: Benenson, Mikhail ; Hwang, Nick ; Canchi, Srivathsan Subject: rpc invocation exceeds the maximum akka framesize

rpc invocation exceeds the maximum akka framesize

2021-09-27 Thread Deshpande, Omkar
Hello, We run a lot of flink applications. Some of them sometimes run into this error on Job Manager- The rpc invocation size exceeds the maximum akka framesize After we increase the framesize the application starts working again. What factors determine the akka framesize? We sometimes see appli