The master UI doesn't return much details, not designed for this
purpose. You need to use the application-level/driver UI instead (on
port 4040/4041...). Please see online doc monitoring and
instrumentation for details
(https://spark.apache.org/docs/latest/monitoring.html#rest-api).
On 10/2
Hi Clayton,
I’m not aware of an official Apache operator, but I can recommend taking a look
a the one we’re created at Stackable.
https://github.com/stackabletech/spark-k8s-operator
It’s actively maintained and we’d be happy to receive feedback if you have
feature requests.
Kind regards,
Jim
Hi Everyone,
I am setting up Spark 3.3 in standalone mode (
https://spark.apache.org/docs/latest/spark-standalone.html) and submitting
spark jobs programatically.
I do have java client program that polls Job status for the jobs submitted
programatically, for which i am using following REST endpoi
