Dear All, Greetings!
I am new to Apache Spark and working on RDDs using pyspark. I am trying to understand the logical plan provided by toDebugString function, but I find two issues a) the output is not formatted when I print the result b) I do not see number of partitions shown. Can anyone direct me to any reference documentation to understand the logical plan better? Or, do you suggest to use DAG from spark UI instead? Thanks & Best Regards, Kanchan Data Engineer, IBM
