Re: akka.remote.OversizedPayloadException after we upgrade to Flink 1.15

2023-05-12 Thread Yang LI
Hi wei, I had a similar issue when I changed from FlinkKafkaConsumer to KafkaSource. In my case, I had the _metadata size increase inside the checkpoint. I have tried to rollback to the old flink version with the old checkpoint/savepoint, and then change the uid of the flink kafka source and sink

Re: akka.remote.OversizedPayloadException after we upgrade to Flink 1.15

2023-05-08 Thread Shammon FY
Hi Wei, >From the error message, I guess the reason for the issue is that the events sent by SplitEnumerator to the source exceeds the default size of akka. You can add the option 'akka.framesize' to set the akka packet size, or try to decrease the event size. When you use 'FlinkKafkaConsumer' to

Re: akka.remote.OversizedPayloadException

2018-04-23 Thread Gary Yao
Hi Alex, Can you try add the following two lines to your flink-conf.yaml? akka.framesize: 314572800b akka.client.timeout: 10min AFAIK it is not needed to use Java system properties here. Best, Gary On Mon, Apr 23, 2018 at 8:48 PM, Alex Soto wrote: > Hello, > > I am using Flink version 1.

Re: akka.remote.OversizedPayloadException

2018-04-23 Thread Ted Yu
I noticed trailing 'b' in your setting. Have you tried without the trailing 'b' ? Cheers On Mon, Apr 23, 2018 at 11:48 AM, Alex Soto wrote: > Hello, > > I am using Flink version 1.4.2. When I try to run my application on a > Yarn cluster, I get this error: > > 2018-04-23 14:08:13,346 ERROR ak