Hey Karthick, The best way to deepen your understanding is by using the Spark Web UI as much as possible while learning the fundamentals of Spark.
To help ease the learning curve, I recommend trying an open-source project called *Dataflint*. It adds an extra tab to the Spark Web UI and presents much of the information in a more straightforward and digestible way. You can check it out here: https://github.com/dataflint/spark I'm one of the contributors to the project. Cheers! *Daniel Aronovich, MSc* On Thu, Sep 26, 2024 at 3:30 PM Ilango <elango...@gmail.com> wrote: > > > Hi Karthick, > > I found one of the spark summit talk few years back on spark UI was quite > useful. Just search in youtube. let me Check it out and will share it with > you if i found it again > > Thanks, > Elango > > > On Thu, 26 Sep 2024 at 4:04 PM, Karthick Nk <kcekarth...@gmail.com> wrote: > >> Hi All, >> I am looking to deepen my understanding of the Spark Web UI. Could anyone >> recommend some useful materials, online courses, or share how you learned >> about it? I've already reviewed the official Spark Web UI documentation, >> but it only covers the basics. >> >> Note: I am using azure databricks for running spark application, >> requesting to share relavent to it if any. >> >> Thank you in advance! >> >
