:00)
Προς: Muhib Khan , "Liu, Jialin"
Κοιν.: user@spark.apache.org
Θέμα: Re: Question about Spark cluster memory usage monitoring
Hello,
Maybe Ganglia http://ganglia.info/ might be useful for you? I have only shallow
experience with it, but it might be what you are looking for.
: Re: Question about Spark cluster memory usage monitoring
Hello,
As far as I know, there is no API provided for tracking the execution memory of
a Spark Worker node. For tracking the execution memory you will probably need
to access the MemoryManager's onHeapExecutionMemoryPool and
o
Hello,
As far as I know, there is no API provided for tracking the execution
memory of a Spark Worker node. For tracking the execution memory you will
probably need to access the MemoryManager's onHeapExecutionMemoryPool
and offHeapExecutionMemoryPool objects that track the memory allocated to
tas
