Hi â I'd like to know if it's possible to access the SparkContext from a Custom Interpreter I am developing. I need access to DataFrames created in earlier paragraphs, so I can transform them and make the results available to subsequent paragraphs.
I was expecting to find the Spark Context on the Interpreter Context that is handed to my Custom Interpreter but this is not the case. I've come across this similar request StackOverflow but it doesn't answer the question: http://stackoverflow.com/questions/37099590/zeppelin-how-to-create-dataframe-from-within-custom-interpreter Can you advise whether this is possible with an externally-contributed Custom Interpreter or would I need to fork the Zeppelin codebase and pull a new interpreter into the Spark package? Many thanks, Michael