Hi, I'm running zeppelin 0.10 with spark 3.1.2 When trying to run %spark.pyspark paragraph, I get ClassNotFoundException: py4j.GatewayServer$GatewayServerBuilder
I see that py4j is a provided scope dependency of spark interpreter, should I explicitly add py4j to the interpreter dependencies? Setting zeppelin.py4j.useAuth to false doesn't help, as the code uses sparkInterpreter.getSparkVersion().isSecretSocketSupported(), and doesn't allow manual control over it. Thanks, Lior