Re: zeppelin jobmanager in local mode

Cool, thanks! On Sun, Oct 24, 2021, 17:00 Jeff Zhang wrote: > JobManager is disabled in 0.10.0 because it cause performance issue, you > can enable it by setting zeppelin.jobmanager.enable to be true in > zeppelin-site.xml > > Lior Chaga 于2021年10月24日周日 下午4:04写道： > >> Hi

Re: zeppelin jobmanager in local mode

Hi, Any clue? Thanks! On Wed, Oct 20, 2021 at 4:14 PM Lior Chaga wrote: > Hi, > Running zeppelin in local mode, I get no data in the job manager. Just > showing spinning wheel: > [image: image.png] > > Zeppelin log shows this every time I try to refresh: > > INFO

zeppelin jobmanager in local mode

Hi, Running zeppelin in local mode, I get no data in the job manager. Just showing spinning wheel: [image: image.png] Zeppelin log shows this every time I try to refresh: INFO [2021-10-20 13:08:31,991] ({qtp631659383-4139} NotebookServer.java[onClose]:474) - Closed connection to 172.30.248.58:54

Error in pyspark

Hi, I'm puzzled - I have zeppelin 0.10 with spark 3.1.2. The driver has Anaconda with python 3.6.5 installed. Running pyspark paragraph, I'm getting some weird behavior. Paragraph runs successfully on first attempt, but then failing on successive attempts (until interpreter restarted). Error is:

Re: Zeppelin 0.10 docker won't start

Ok, that seemed to work :-) Thanks On Wed, Sep 22, 2021 at 12:14 PM Lior Chaga wrote: > I figured it works for most ppl, otherwise someone would have reported it > already. > I'm trying to swipe all docker images and containers and relaunch. > > On Wed, Sep 22, 2021 at

Re: Zeppelin 0.10 docker won't start

I figured it works for most ppl, otherwise someone would have reported it already. I'm trying to swipe all docker images and containers and relaunch. On Wed, Sep 22, 2021 at 12:11 PM Jeff Zhang wrote: > Not sure what's wrong on your side, this command works for me. > > > L

Re: Zeppelin 0.10 docker won't start

docker run -p 8080:8080 --rm --name zeppelin apache/zeppelin:0.10.0 On Wed, Sep 22, 2021 at 12:04 PM Jeff Zhang wrote: > which command to you use to launcher docker ? > > Lior Chaga 于2021年9月22日周三 下午5:02写道： > >> Hi, >> >> Trying to launch zeppelin 0.10 docker on

Zeppelin 0.10 docker won't start

Hi, Trying to launch zeppelin 0.10 docker on mac following the instructions here Docker image exists immediately with exit code 1. Container log does not exist, and I could find no clue for it in doc

Re: ClassNotFoundException: py4j.GatewayServer$GatewayServerBuilder

f = spark.range(10).createOrReplaceTempView("d") spark.sql("select np_sqrt(id) as arr from d").show(truncate=False) Thanks On Sun, Sep 12, 2021 at 6:09 PM Jeff Zhang wrote: > We have integration test for spark 3.1.2, it is supposed to work. Could > you let us know how

ClassNotFoundException: py4j.GatewayServer$GatewayServerBuilder

Hi, I'm running zeppelin 0.10 with spark 3.1.2 When trying to run %spark.pyspark paragraph, I get ClassNotFoundException: py4j.GatewayServer$GatewayServerBuilder I see that py4j is a provided scope dependency of spark interpreter, should I explicitly add py4j to the interpreter dependencies? Sett

Re: notebook search fails

the > Zeppelin Server Pod, this option rebuilds the index on every startup. > > Of course, rebuilding can take a long time and consumes resources during > rebuilding, depending on how many notes you have. > > I hope you can solve the problem like me. > > Best regards > Phi

notebook search fails

Hi, I'm facing the same issue as Axel reported in https://issues.apache.org/jira/browse/ZEPPELIN-5437 (but without the preceding NullPointerExceptions) To be honest, when I first tried remote debug to understand why I don't see results, I managed to debug into the SearchService, to make sure it's

Re: loading interpreter repositories from interpreter settings

https://issues.apache.org/jira/browse/ZEPPELIN-5485 On Wed, Aug 11, 2021 at 9:06 AM Lior Chaga wrote: > Gladly > > On Wed, Aug 11, 2021 at 9:01 AM Jeff Zhang wrote: > >> It seems a bug that additional configured repo doesn't work, could you >> create a ticket fo

Re: loading interpreter repositories from interpreter settings

Gladly On Wed, Aug 11, 2021 at 9:01 AM Jeff Zhang wrote: > It seems a bug that additional configured repo doesn't work, could you > create a ticket for it ? > > > Lior Chaga 于2021年8月11日周三 下午1:50写道： > >> Default central repo doesn't fail, but behind VPN the

Re: loading interpreter repositories from interpreter settings

pdate, not sure how default central repo fails. Is it due > to you unable to access the default maven repo ? > > Lior Chaga 于2021年8月11日周三 下午12:50写道： > >> I found a non-patch solution, just setting >> "zeppelin.interpreter.dep.mvnRepo" to desired repo (replacing defaul

Re: loading interpreter repositories from interpreter settings

I found a non-patch solution, just setting "zeppelin.interpreter.dep.mvnRepo" to desired repo (replacing default central repo) But IMO there's still a bug (if someone simply cannot replace default repo and have to add one) On Tue, Aug 10, 2021 at 10:29 AM Lior Chaga wrote: > I

loading interpreter repositories from interpreter settings

I'm facing an issue loading repositories from the settings file. Zeppelin uses gson to load the saved repositories, and as RemoteRepository doesn't have a setter for protocol, it instantiates a RemoteRepository with null protocol (not going through the Builder which resolves the protocol from the u

Re: Migrating zeppelin notebooks

Oh, found it - https://github.com/apache/zeppelin/pull/3189 Sorry for spam On Sun, Aug 1, 2021 at 2:14 PM Lior Chaga wrote: > Hi, > Is there an out of the box migration tool for zeppelin notebooks when > upgrading from 0.8.2? (https://issues.apache.org/jira/browse/ZEPP

Migrating zeppelin notebooks

Hi, Is there an out of the box migration tool for zeppelin notebooks when upgrading from 0.8.2? (https://issues.apache.org/jira/browse/ZEPPELIN-2619) Specifically when using FileSystemNotebookRepo? Thanks!

Re: Local spark interpreter with extra java options

Awesome, thanks Jeff. On Sun, Jul 25, 2021 at 11:24 AM Jeff Zhang wrote: > Hi Lior， > > It would be fixed in https://github.com/apache/zeppelin/pull/4127 > > > Lior Chaga 于2021年7月25日周日 下午3:58写道： > >> After a couple of attempts of code fixes, when every time I seemed

Re: Local spark interpreter with extra java options

ul 11, 2021 at 1:30 PM Lior Chaga wrote: > Thanks Jeff, > So I should escape the whitespaces? Is there a ticket for it? couldn't > find one > > On Sun, Jul 11, 2021 at 1:10 PM Jeff Zhang wrote: > >> I believe this is due to SparkInterpreterLauncher doesn't support &

Re: Local spark interpreter with extra java options

er to > separate parameters), this is a known issue > > Lior Chaga 于2021年7月11日周日 下午4:14写道： > >> So after adding the quotes in both SparkInterpreterLauncher >> and interpreter.sh, interpreter is still failing with same error of >> Unrecognized option. >> But the

Re: Local spark interpreter with extra java options

SL=false&databaseTerm=SCHEMA&nullDatabaseMeansCurrent=true> -Djavax.jdo.option.ConnectionUserName=hms_rw" * --conf "spark.files.overwrite=true" /zeppelin/interpreter/spark/spark-interpreter-0.10.0-SNAPSHOT.jar 10.135.120.245 36419 spark-shared_process : *

Re: Local spark interpreter with extra java options

is is indeed the issue (and I'm not missing anything), so I'd open a pull request. On Thu, Jul 8, 2021 at 3:05 PM Lior Chaga wrote: > I'm trying to run zeppelin using local spark interpreter. > Basically everything works, but if I try to set > `spar

Local spark interpreter with extra java options

I'm trying to run zeppelin using local spark interpreter. Basically everything works, but if I try to set `spark.driver.extraJavaOptions` or `spark.executor.extraJavaOptions` containing several arguments, I get an exception. For instance, for providing `-DmyParam=1 -DmyOtherParam=2`, I'd get: Error

Re: Running spark interpreter with zeppelin on k8s

Ok, I've tried it. Indeed it doesn't look for a spark pod. Other issues though, but if I wouldn't overcome I'll open a new thread. Thanks Jeff! On Wed, Jun 23, 2021 at 11:40 AM Jeff Zhang wrote: > set zeppelin.run.mode in zeppelin-site.xml to be local > > Lior

Running spark interpreter with zeppelin on k8s

I'm trying to deploy zeppelin 0.10 on k8s, using following manual build: mvn clean package -DskipTests -Pspark-scala-2.12 -Pinclude-hadoop -Pspark-3.0 -Phadoop2 -Pbuild-distr -pl zeppelin-interpreter,zeppelin-zengine,spark/interpreter,spark/spark-dependencies,zeppelin-web,zeppelin-server,zeppeli