6 AM Cheng Pan wrote:
> FYI, I have submitted SPARK-48651(
> https://github.com/apache/spark/pull/47010) to update the Spark on YARN
> docs for JDK configuration, looking forward to your feedback.
>
> Thanks,
> Cheng Pan
>
>
> On Jun 18, 2024, at 02:00, George Magiros wr
I successfully submitted and ran org.apache.spark.examples.SparkPi on Yarn
using 4.0.0-preview1. However I got it to work only after fixing an issue
with the Yarn nodemanagers (Hadoop v3.3.6 and v3.4.0). Namely the issue
was:
1. If the nodemanagers used java 11, Yarn threw an error about not find
