Re: Flink serialization errors at a batch job

2022-05-09 Thread Robert Metzger
Hi, I suspect that this error is not caused by Flink code (because our serializer stack is fairly stable, there would be more users reporting such issues if it was a bug in Flink). In my experience, these issues are caused by broken serializer implementations (e.g. a serializer being used by multi

Flink serialization errors at a batch job

2022-05-03 Thread Yunus Olgun
Hi, We're running a large Flink batch job and sometimes it throws serialization errors in the middle of the job. It is always the same operator but the error can be different. Then the following attempts work. Or sometimes attempts get exhausted, then retrying the job. The job is basically readin