Re: Other paragraphs do not wait for %sh paragraphs to finish.

2017-04-06 Thread Rick Moritz
This actually calls for a dependency definition of notes within a notebook, so the scheduler can decide which tasks to run simultaneously. I suggest a simple counter of dependency levels, which by default increases with every new note and can be decremented to allow notes to run simultaneously. Run

Re: Other paragraphs do not wait for %sh paragraphs to finish.

2017-04-06 Thread Jeff Zhang
That's correct, it needs define dependency between paragraphs, e.g. %spark(deps=p1), so that we can build DAG for the whole pipeline. Rick Moritz 于2017年4月6日周四 下午3:28写道: > This actually calls for a dependency definition of notes within a > notebook, so the scheduler can decide which tasks to

Re: no interpreters

2017-04-06 Thread Raffaele S
Hello, NPMs are optional so there is no need to download them. Can you please post a full log (*.log, *out)? Raffaele 2017-04-03 23:54 GMT+02:00 Knapp, Michael : > Zeppelin Developers, > > > > I am struggling to get Zeppelin to work. I am running version 0.7.1 on an > amazon linux EC2 instan

multiple instances of the same interpreter type

2017-04-06 Thread Ruslan Dautkhanov
A user managed somehow to launch multiple instances of spark interpreter under the same Zeppelin server. See a snippet of `pstree` output: |-java,6360,wabramov -Dfile.encoding=UTF-8 -Xms1024m -Xmx2048m -XX:MaxPermSize=512m-Dlog4j.configuration=file:///home/wabramov/ | |-interpreter.sh,4510

Re: Other paragraphs do not wait for %sh paragraphs to finish.

2017-04-06 Thread Ruslan Dautkhanov
Filed https://issues.apache.org/jira/browse/ZEPPELIN-2368 We had users asking the same.. it forced them to run paragraphs one by one manually. -- Ruslan Dautkhanov On Wed, Apr 5, 2017 at 4:57 PM, moon soo Lee wrote: > Hi, > > That's expected behavior at the moment. The reason is > > Each i

Re: Other paragraphs do not wait for %sh paragraphs to finish.

2017-04-06 Thread Ruslan Dautkhanov
Apart from introducing a full-blown graph of DAG dependencies, a simpler solution might be introducing a paragraph-level property "depends on previous paragraph" (boolean), so in run-all-paragraphs run, this particular paragraph wouldn't be scheduled until previous one is complete (without errors).

Re: Other paragraphs do not wait for %sh paragraphs to finish.

2017-04-06 Thread Jeff Zhang
"depends on previous paragraph" could be the default behavior is no deps is specified. Specifying dependencies explicitly could benefit the performance. e.g. In the spark tutorial note, the 3 sql could run at the same time independently. Ruslan Dautkhanov 于2017年4月7日周五 上午1:09写道: > Apart from int

Re: multiple instances of the same interpreter type

2017-04-06 Thread Jeff Zhang
What mode do you use ? Ruslan Dautkhanov 于2017年4月7日周五 上午12:49写道: > A user managed somehow to launch multiple instances of spark interpreter > under the same Zeppelin server. > > See a snippet of `pstree` output: > > |-java,6360,wabramov -Dfile.encoding=UTF-8 -Xms1024m -Xmx2048m > -XX:MaxPermS