Re: PySpark with livy

2017-09-30 Thread Mauro Schneider
Hi Jeff Yes, the code work with PySpark Shell and the Spark Submit in the same server where is running the Zeppelin and Livy. And I did an another test, I executed the same code with cUrl using to Livy and work ok. Mauro Schneider On Fri, Sep 29, 2017 at 8:26 PM, Jeff Zhang wrote: > It is

Re: Implementing run all paragraphs sequentially

2017-09-30 Thread Michael Segel
Sorry to jump in… If you want to run paragraphs in parallel, you are going to want to have some sort of dependency graph. Think of a common set up where you need to set up common functions and imports. (setup of %spark.dep) A good example is if your notebook is a bunch of unit tests and you ne