Re:Re: is there any tool to visualize the spark physical plan or spark plan

2020-05-01 Thread zhangliyun
Hi Wenchen Fan: thanks for reply. in the link, i saw sql metrics which is very userful. ``` SQL metrics The metrics of SQL operators are shown in the block of physical operators. The SQL metrics can be useful when we want to dive into the execution details of each operator. For example

Re:Re: is there any tool to visualize the spark physical plan or spark plan

2020-04-30 Thread zhangliyun
really thanks for your suggestion At 2020-04-30 17:30:13, "Manu Zhang" wrote: Hi Kelly, If you can parse event log, then try listening on `SparkListenerSQLExecutionStart` event and build a `SparkPlanGraph` like https://github.com/apache/spark/blob/master/sql/core/src/main/scala/