Re: z.load() Must be used before SparkInterpreter (%spark) initialized?

2017-07-26 Thread Rick Moritz
Please allow me to opinionate on that subject: To me, there are two options: Indeed you either run the Spark interpreter in isolated mode, or you have dedicated Spark Interpreter-Groups per organziational unit, so you can manage dependencies independently. Obviously, there's no way around restarti

Re: Can't download moderately large data or number of rows to csv

2017-05-03 Thread Rick Moritz
I think whether this is an issue or not, depends a lot on how you use Zeppelin, and what tools you need to integrate with. Sadly Excel is still around as a data processing tool, and many people who I introduce to Zeppelin are quite proficient with it, hence the desire to export to csv in a trivial

Re: multiple instances of the same interpreter type

2017-04-07 Thread Rick Moritz
Which version of Zeppelin are you running? There was a bug, where killing Zeppelin wouldn't actually kill the interpreters, because the kill signal wasn't passed through, but that was fixed in 0.7.1: https://issues.apache.org/jira/browse/ZEPPELIN-2258 On Fri, Apr 7, 2017 at 5:31 PM, Ruslan Dautkha

Re: Other paragraphs do not wait for %sh paragraphs to finish.

2017-04-06 Thread Rick Moritz
This actually calls for a dependency definition of notes within a notebook, so the scheduler can decide which tasks to run simultaneously. I suggest a simple counter of dependency levels, which by default increases with every new note and can be decremented to allow notes to run simultaneously. Run

Re: why not provide 'test' function in the interpreter

2017-02-06 Thread Rick Moritz
Having gone through configuring Spark 1.6 for Z 0.6.2 without bein able to use the installer, and using "provided" Spark and Hadoop, I do understand the appaeal of a test functionality for an interpreter. The challenge of scoping the test functionality is evident, but I think not insurmountable.