This actually calls for a dependency definition of notes within a notebook,
so the scheduler can decide which tasks to run simultaneously.
I suggest a simple counter of dependency levels, which by default increases
with every new note and can be decremented to allow notes to run
simultaneously. Run
That's correct, it needs define dependency between paragraphs, e.g.
%spark(deps=p1), so that we can build DAG for the whole pipeline.
Rick Moritz 于2017年4月6日周四 下午3:28写道:
> This actually calls for a dependency definition of notes within a
> notebook, so the scheduler can decide which tasks to
Hello,
NPMs are optional so there is no need to download them.
Can you please post a full log (*.log, *out)?
Raffaele
2017-04-03 23:54 GMT+02:00 Knapp, Michael :
> Zeppelin Developers,
>
>
>
> I am struggling to get Zeppelin to work. I am running version 0.7.1 on an
> amazon linux EC2 instan
A user managed somehow to launch multiple instances of spark interpreter
under the same Zeppelin server.
See a snippet of `pstree` output:
|-java,6360,wabramov -Dfile.encoding=UTF-8 -Xms1024m -Xmx2048m
-XX:MaxPermSize=512m-Dlog4j.configuration=file:///home/wabramov/
| |-interpreter.sh,4510
Filed https://issues.apache.org/jira/browse/ZEPPELIN-2368
We had users asking the same.. it forced them to run paragraphs one by one
manually.
--
Ruslan Dautkhanov
On Wed, Apr 5, 2017 at 4:57 PM, moon soo Lee wrote:
> Hi,
>
> That's expected behavior at the moment. The reason is
>
> Each i
Apart from introducing a full-blown graph of DAG dependencies, a simpler
solution
might be introducing a paragraph-level property "depends on previous
paragraph" (boolean),
so in run-all-paragraphs run, this particular paragraph wouldn't be
scheduled until
previous one is complete (without errors).
"depends on previous paragraph" could be the default behavior is no deps is
specified. Specifying dependencies explicitly could benefit the
performance. e.g. In the spark tutorial note, the 3 sql could run at the
same time independently.
Ruslan Dautkhanov 于2017年4月7日周五 上午1:09写道:
> Apart from int
What mode do you use ?
Ruslan Dautkhanov 于2017年4月7日周五 上午12:49写道:
> A user managed somehow to launch multiple instances of spark interpreter
> under the same Zeppelin server.
>
> See a snippet of `pstree` output:
>
> |-java,6360,wabramov -Dfile.encoding=UTF-8 -Xms1024m -Xmx2048m
> -XX:MaxPermS