`running-on-kubernetes` page render bad in v3.2.1(latest) website

2022-03-02 Thread Yikun Jiang
Looks like the `running-on-kubernetes` page encounterd some problems when published. [1] https://spark.apache.org/docs/latest/running-on-kubernetes.html#spark-properties (You can see bad format after #spark-properties) - I also check the master branch (setup local env) and also v3.2.0 ( https://

Re: Reason/rationale for using a service for the driver when running Spark on Kubernetes?

2022-03-02 Thread Mich Talebzadeh
Hi Simon, These are relatively old documents. Specifically, what issues are you foreseeing because of the driver service? HTH view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your o

Reason/rationale for using a service for the driver when running Spark on Kubernetes?

2022-03-02 Thread Simon van der Veldt
Hi Spark devs, Does anyone know what the reason/rationale was for using/creating a service for the driver when running Spark on Kubernetes? The PR (https://github.com/apache/spark/pull/19717) and the commit (https://github.com/mccheah/spark/commit/3f4060c340d6bac412e8819c4388ccba226efcf3) that add