ClassNotFoundException: py4j.GatewayServer$GatewayServerBuilder

2021-09-12 Thread Lior Chaga
Hi, I'm running zeppelin 0.10 with spark 3.1.2 When trying to run %spark.pyspark paragraph, I get ClassNotFoundException: py4j.GatewayServer$GatewayServerBuilder I see that py4j is a provided scope dependency of spark interpreter, should I explicitly add py4j to the interpreter dependencies? Sett

Re: ClassNotFoundException: py4j.GatewayServer$GatewayServerBuilder

2021-09-12 Thread Jeff Zhang
We have integration test for spark 3.1.2, it is supposed to work. Could you let us know how to reproduce it ? Lior Chaga 于2021年9月12日周日 下午8:17写道: > Hi, > > I'm running zeppelin 0.10 with spark 3.1.2 > When trying to run %spark.pyspark paragraph, I get ClassNotFoundException: > py4j.GatewayServer$

Re: ClassNotFoundException: py4j.GatewayServer$GatewayServerBuilder

2021-09-12 Thread Lior Chaga
Hi Jeff, I'm building my custom zeppelin: mvn clean package -DskipTests -Pweb-angular -Pspark-scala-2.12 -Pinclude-hadoop -Pspark-3.0 -Phadoop2 -Pbuild-distr -pl zeppelin-interpreter,zeppelin-zengine,spark/interpreter,spark/spark-dependencies,zeppelin-web-angular,zeppelin-server,zeppelin-distribu