Hello. I would like to be able to understand in a better way what spark UI and physical plan gives me. However, no tutorial or whatever tell the reader what is the number in front of a physical plan line.
For example : == Physical Plan == 2 *(1) Project [(id#0L * 5) AS id#2L] 3 +- *(1) Range(1, 1000000, step=1, splits=6) The *(1), does it represent the stage in spark UI ? If not, what is it ? Moreover, how can I match a spark UI stage to an action of my program ? I am using spark UI 2.3 with spark 2.1 (company Policy, not able to upgrade) and spark UI is not helping much to understand in details which action is executed in a stage. Thanks and have a good day. Provenance : Courrier<https://go.microsoft.com/fwlink/?LinkId=550986> pour Windows 10
