Re: Kryo Serialization issues in Flink Jobs.

2021-11-02 Thread Timo Walther
Hi Prasanna, it could be a bug where the ExecutionConfig is not forwarded properly to all locations where the KryoSerializer is used. As a first step for debugging, I would recommend to create a custom TypeInformation (most methods are not relevant except for createTypeSerializer and getType

Re: Kryo Serialization issues in Flink Jobs.

2021-11-01 Thread Prasanna kumar
Any thoughts on these ? Thanks, Prasanna. On Sat, Oct 30, 2021 at 7:25 PM Prasanna kumar < prasannakumarram...@gmail.com> wrote: > Hi , > > We have the following Flink Job that processes records from kafka based on > the rules we get from S3 files into broadcasted state. > Earlier we were able t

Kryo Serialization issues in Flink Jobs.

2021-10-30 Thread Prasanna kumar
Hi , We have the following Flink Job that processes records from kafka based on the rules we get from S3 files into broadcasted state. Earlier we were able to spin a job with any number of task parallelism without any issues. Recently we made changes to the Broadcast state Structure and it is work