Dear All, I am struggling since more than a week on the following problem.
My Zeppelin Server is running outside the k8s cluster (there is a reason for
this) and I am able to run Spark zeppelin notes in Client mode but not in
Cluster mode.
I see that, at first, a pod for the interpreter (RemoteI
gt; interpreter. You will find the call in these lines:
> https://github.com/apache/zeppelin/blob/2f55fe8ed277b28d71f858633f9c9d76fd18f0c3/bin/interpreter.sh#L303-L305
>
> Best Regards
> Philipp
>
>
> Am 25.10.21 um 21:58 schrieb Fabrizio Fab:
> > Dear All, I am struggling sin
al
> Spark submit execution would do in cluster mode.
>
> Spark-submit is called only once during the start of the Zeppelin
> interpreter. You will find the call in these lines:
> https://github.com/apache/zeppelin/blob/2f55fe8ed277b28d71f858633f9c9d76fd18f0c3/bin/interpreter.
lin always uses client mode.
>
> The architecture is quite simple:
>
> Zeppelin-Server -> Zeppelin-Interpreter (with Spark in client mode) on
> K8s -> x-Spark-executors (based on your config)
>
> Best Regards
> Philipp
>
>
> Am 27.10.21 um 15:19 schrieb Fab
I am aware that Spark 3.20 is not officially released, but I am trying to put
it to work.
The first thing that I noticed is the following:
the SparkInterpreter is compiled for Scala 2.12.7
Spark 3.2 is compiled for Scala 2.12.15
Unfortunately there are some breaking changes between the two ver
