Hey Starting spark 3.4.0 they have introduced a decoupled client-server architecture for spark. How about we can start thinking of porting the zeppelin interpreter to use the same architecture for spark interpreter.
References: https://spark.apache.org/docs/latest/spark-connect-overview.html https://spark.apache.org/docs/latest/api/python/getting_started/quickstart_connect.html Looking up for views of the community on this. Thanks and Regards. Ankit Prakash Gupta info.ank...@gmail.com +91 8750101321
