Hi Dylan, the container's memory will be calculated here [1]. In the case of Yarn, the user specifies the container memory size and based on this Flink calculates with how much heap memory the JVM is started (container memory size - off heap memory - cut off memory).
[1] https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/clusterframework/ContaineredTaskManagerParameters.java#L160 Cheers, Till On Tue, May 7, 2019 at 3:29 PM Dylan Adams <dylan.ad...@gmail.com> wrote: > In the Configuration section of the docs > <https://ci.apache.org/projects/flink/flink-docs-release-1.8/ops/config.html#taskmanager>, > the description for "taskmanager.heap.size" contains: "On YARN setups, > this value is automatically configured to the size of the TaskManager's > YARN container, minus a certain tolerance value." > > Does that functionality exist? > > I don't see any documented method to specify the YARN container size for > the TaskManagers, nor could I find any logic in the Flink YARN integration > code that seemed to implement that behavior. > > My understanding is that you need to manually calculate and specify > taskmanager.heap.size > (and jobmanager.heap.size) based on your YARN setup. > > Thanks, > Dylan >
