Hi, all
i have some questions about debug in spark:
1) when application finished, application UI is shut down, i can not see
the details about the app, like
shuffle size, duration time, stage information... there are not
sufficient informations in the master UI.
do i need to hang the application on?
2) how to get details about each task the executor run? like memory
usage...
3) since i'am not familiar with JVM. do i need to run the program step by
step or hang on the program
to use JVM utilities like jstack, jmap...
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/questions-about-debugging-a-spark-application-tp4891.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
