Hmm, that's right. Does only user isolated work for you ?

Dima Kamalov <dimakama...@asana.com> 于2019年7月29日周一 下午12:03写道:

> This does not fix the problem when a Spark session crashes.   If a user
> has multiple notes in scoped mode, restarting one note will not restart the
> interpreter group -- it will only restart the session.  This will restart
> the Scala REPL but not e.g. the Spark session.
>
> On Sun, Jul 28, 2019 at 6:16 PM Jeff Zhang <zjf...@gmail.com> wrote:
>
>> Restarting interpreter in note page will only restart that note's owner's
>> interpreter, won't affect other users' interpreter.
>>
>>
>> Dima Kamalov <dimakama...@asana.com> 于2019年7月27日周六 上午9:51写道:
>>
>>> Hi,
>>>
>>> I'm wondering whether there are any best practices around restarting a
>>> user's interpreter group.  (E.g. the whole set of sessions for that user,
>>> but not sessions for other users.)
>>>
>>> Here's the problem I want to solve:
>>>
>>> - We are primarily using Zeppelin for the spark interpreter.  Because
>>> each user has a number of notebooks, it seemed like a good idea to pool
>>> spark sessions per user so we did that by setting spark interpreter to user
>>> isolated, note scoped.
>>> - Periodically, a user's spark session will crash for whatever reason.
>>>
>>> Here's the possible solutions that I can think of.  We're currently
>>> using 1a.
>>> (1) Within existing interpreter mode
>>> a. Restart the spark interpreter from the interpreter menu.  This
>>> restarts it for ~30 users, so it's inconvenient to do often.
>>> b. Track down all of a user's notebooks, and restart the spark
>>> interpreter in each notebook.
>>>
>>> (2) Considering switching interpreter modes
>>> a. User isolated, note isolated -- our biggest concern with this is just
>>> the number of spark sessions that would get generated.  Maybe this would
>>> play well with lifecycle management?
>>> b. User isolated -- seems a little bad for users because a variable
>>> updated in one note would overwrite the same variable in another note.
>>>
>>> (3) Work on a change to Zeppelin, assuming this feature doesn't exist yet
>>> a. In the interpreter menu, we can have the restart option ask whether
>>> to restart the interpreter only for the user or globally?  Or maybe it only
>>> makes sense to allow to restarting it for the user?  It seems like there's
>>> a more major undertaking for
>>> https://issues.apache.org/jira/browse/ZEPPELIN-1338 so I don't want to
>>> conflict with that direction.
>>>
>>> Have other people run into this problem?  Are there solution options I'm
>>> missing?  What option have you chosen?
>>>
>>> Thank you!
>>> Dima
>>>
>>
>>
>> --
>> Best Regards
>>
>> Jeff Zhang
>>
>

-- 
Best Regards

Jeff Zhang

Reply via email to