Hi Reinier,
this is in fact a bug that you stumbled upon.
In general, Flink works very well with larger data sets and little memory
and gracefully spills data to disk.
The problem in your case is caused by a wrapped exception.
Internally, Flink uses an EOFException to signal that the memory pool
Hi all,
I’ve been running a Beam pipeline on Flink. Depending on the dataset size and
the heap memory configuration of the jobmanager and taskmanager, I may run into
an EOFException, which causes the job to fail. You will find the stacktrace
near the bottom of this post (data censored).
I woul
