Re: CPU jump and high epollwait as throughput increases

2020-11-07 Thread Till Rohrmann
Hi Giselle, could you share the logs of this run with us? They might contain some details. Could you also give us a bit more details about the Flink job and which Flink version you are using? Have you tried using a different netty transport type via `taskmanager.network.netty.transport`? You coul

CPU jump and high epollwait as throughput increases

2020-11-07 Thread Giselle van Dongen
Dear community, We have a Flink job which does some parsing, a join and a window. When we increase the load, CPU increases gradually with the throughput. But around 65% CPU, there is suddenly a jump to 98%. The job starts experiencing backpressure and becomes unstable (increasing latency, memory