Re: Custom Spark Interpreter?

2018-01-24 Thread Jeff Zhang
But if you don't set it in interpreter setting, it would get spark ui url dynamically. ankit jain 于2018年1月25日周四 下午3:03写道: > That method is just reading it from a config defined in interpreter > settings called "uiWebUrl" which makes it configurable but still static. > > On Wed, Jan 24, 2018 at

Re: Custom Spark Interpreter?

2018-01-24 Thread ankit jain
That method is just reading it from a config defined in interpreter settings called "uiWebUrl" which makes it configurable but still static. On Wed, Jan 24, 2018 at 10:58 PM, Jeff Zhang wrote: > > IIRC, spark interpreter can get web ui url at runtime instead of static > url. > > https://github.c

Re: Custom Spark Interpreter?

2018-01-24 Thread Jeff Zhang
IIRC, spark interpreter can get web ui url at runtime instead of static url. https://github.com/apache/zeppelin/blob/master/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java#L940 ankit jain 于2018年1月25日周四 下午2:55写道: > Issue with Spark UI when running on AWS EMR is it requires ss

Re: Custom Spark Interpreter?

2018-01-24 Thread ankit jain
Issue with Spark UI when running on AWS EMR is it requires ssh tunneling to be setup which requires private aws keys. Our team is building a analytic platform on zeppelin for end-users who we obviously can't hand out these keys. Another issue is setting up correct port - Zeppelin tries to use 404

Re: Custom Spark Interpreter?

2018-01-24 Thread Jeff Zhang
If Spark interpreter didn't give you the correct spark UI, this should be a bug, you can file a ticket to fix it. Although you can make a custom interpreter by extending the current spark interpreter, it is not a trivial work. ankit jain 于2018年1月25日周四 上午8:07写道: > Hi fellow Zeppelin users, > Has

Custom Spark Interpreter?

2018-01-24 Thread ankit jain
Hi fellow Zeppelin users, Has anyone tried to write a custom Spark Interpreter perhaps extending from the one that ships currently with zeppelin - spark/src/main/java/org/ apache/zeppelin/spark/*SparkInterpreter.java?* We are coming across cases where we need the interpreter to do "more", eg chang

User based Notebook Repo

2018-01-24 Thread Roshan Punnoose
I want to create a notebook repository that will return notes that only the user can see. The NotebookRepo seems to work well; however, it seems like it caches the data in the Notebook class and all users can see any Note that is loaded. Is there a way to tell the ZeppelinServer/Notebook classes to