Hi Kevin,

You are right RocksDB is probably responsible for the memory consumption you 
are noticing. We have definitely seen similar issues in the past and 
with the latest Flink version 1.14 we tried to restrict the RocksDB memory 
consumption even more to make it better controllable.

Can you tell is a bit more about the job you are using and the respective Flink 
version? I would be also interested what kind of memory 
configurations you did on the flink cluster i.e. 
taskmanager.memory.process.size. You can also have a look at the following docs 
pages [1] to 
fine tune the memory consumption of your job.

Please let me know if that helps.

Best,
Fabian


[1] 
https://ci.apache.org/projects/flink/flink-docs-master/docs/deployment/memory/mem_setup/#configure-total-memory


Reply via email to